Senior Big Data Engineer - Amberdata

Senior Big Data Engineer

Amberdata

About the Role:

We are seeking an experienced Senior Big Data Engineer to join our team and help build a cutting-edge platform in the fast-evolving world of digital assets and financial markets. If you’re passionate about tackling big data challenges and working with distributed systems, this is the perfect opportunity for you. You will be instrumental in developing high-performance, scalable systems that process and store petabytes of data, driving the future of blockchain technology, cryptocurrency, and DeFi platforms.

Responsibilities:

• Innovative Technical Solutions: Work on complex technical challenges, designing end-to-end solutions to process and store vast amounts of data.
• High-Performance Code: Write performant, clean, and well-tested code that can handle the scale and demands of distributed systems.
• DevOps Integration: Use Continuous Delivery practices and DevOps tools to ensure seamless delivery and deployment of software solutions.
• Big Data Best Practices: Define and establish best practices and guidelines for managing large-scale data processing systems.
• Collaborative Environment: Contribute to the overall architecture, shaping solutions and ideas in a collaborative, fast-paced environment.
• Data Workflow Management: Design and manage data workflows using orchestration tools such as Airflow, Luigi, Dagster, and more.
• Stream Processing: Work with stream processing frameworks like Flink or Storm to support real-time data processing needs.
• Monitoring and Validation: Ensure high standards for pipeline monitoring, data validation, and testing, ensuring reliability and scalability of systems.
• Analytical and Operational Data Models: Create efficient data models to meet both analytical and operational use cases, leveraging big data technologies.
• Cloud Native Architectures: Leverage AWS, Kubernetes, Docker, and other cloud-native tools to develop robust infrastructure for high availability and scalability.

What We’re Looking For:

• Experience: 8+ years of hands-on experience in coding, software design, and big data architecture.
• Programming Expertise: Proficiency in at least two programming languages, with deep expertise in Java, Scala, Go, or Python.
• Big Data Tools: Experience with Hadoop, EMR, Pig, Hive, Databricks, or similar big data processing frameworks.
• Stream Processing: Familiarity with stream processing frameworks like Flink or Storm.
• Data Orchestration: Experience in managing data workflows with orchestration tools such as Airflow, Luigi, Dagster, etc.
• DevOps Mindset: Strong understanding of DevOps, infrastructure as code, Continuous Delivery, and Test-Driven Development (TDD).
• Cloud Infrastructure: Hands-on experience with AWS, Kubernetes, Docker, and other cloud-native technologies.
• Academic Qualifications: A degree in a related field (Bachelor’s, Master’s, or PhD), or a compelling reason for not having one.
• Excellent Communication: Strong written and verbal communication skills to effectively collaborate with cross-functional teams.

What We Offer:

• Competitive Salary: Attractive salary package including very competitive stock options.
• Employee Benefits: Comprehensive healthcare benefits (medical, dental, vision) and 401k.
• Growth Opportunities: Unparalleled opportunities to help build a category-defining company at the intersection of blockchain, cryptocurrency, and Web3.
• 100% Remote Work: Work from anywhere and collaborate with a global team of professionals.

How to Apply:

If you’re ready to help build the future of big data solutions for the digital assets and financial markets space, send your resume to jobs@amberdata.io to apply.