Data Platform Engineer

What To Expect Day To Day

We are seeking a highly skilled and experienced Data Platform engineer to join our team. The ideal candidate will have a strong background in data platform engineering technologies and infrastructure.

As a Data Platform engineer, you will design, build, operate, and continuously improve our cloud-native data platform and data pipelines. The successful candidate will work closely with data engineers, AI and analytics teams and platform stakeholders to develop scalable, secure, and resilient data infrastructure following Infrastructure as Code and DevOps best practices.

You will also participate in selection and adoption of technologies for Big Data processing, frameworks and processes so it can be standardized and adopted across multiple projects. You will be involved in both the discovery and delivery phases of development projects, ensuring that the correct technical strategies are considered early in the product development and take a hands - on approach to ensure that the projects are delivered on – time to high – quality. You will drive the development and adoption of reusable frameworks components and provide mentorship to all software and data engineers to ensure consistency of implementation between project teams. 

You'll have the opportunity to work with the latest technologies and tools on infrastructure that is running on the Databricks clusters. You'll be encouraged to stay up – to – date with the latest trends and advancements in the industry, and to share your knowledge and ideas with the team. 

In this role, you'll be part of a team that is passionate about using technology to solve complex problems and make a real impact in the world. If you're excited about the idea of working on a project that has the potential to change the way we think about energy, then we'd love to hear from you!

Responsibilities

• Design, implement, and support scalable data platform solutions on AWS.
• Develop and optimize data processing workloads using Apache Spark and Databricks.
• Build and maintain streaming data solutions using Apache Kafka and Amazon MSK.
• Manage cloud infrastructure using an Infrastructure as Code (IaC) approach, with a strong focus on automation and repeatability.
• Develop and maintain CI/CD pipelines to ensure reliable deployment of platform components and data workloads.
• Implement security best practices, including identity and access management controls.
• Design and support Disaster Recovery (DR) and business continuity strategies for critical platform services.
• Monitor platform health, performance, and reliability, proactively identifying areas for improvement.
• Collaborate with engineering teams to improve platform scalability, observability, and operational excellence.

Essential Criteria

• 3+ years of experience in Data Engineering or Data Platform engineering roles
• Strong knowledge of Apache Spark.
• Experience working with Databricks for large-scale data processing and analytics.
• Good knowledge of AWS services, including S3, AWS IAM, EC2, RDS and MSK
• Understanding of cloud architecture, security, and operational best practices.
• Strong understanding of Apache Kafka concepts, architecture, and operations.
• Experience designing and supporting event-driven and streaming data solutions.
• Proficiency in Terraform for infrastructure provisioning and management.
• Strong commitment to an Infrastructure as Code First approach,
• Experience developing and maintaining CI/CD pipelines using modern DevOps tools and practices.
• Solid proficiency in Python for automation, platform engineering, and data processing tasks.
• Understanding of Disaster Recovery, backup strategies, high availability, and business continuity planning.
• Fluency in English, written and verbal

Desirable Criteria

• Bachelor's degree in computer software engineering or equivalent
• Experience building SaaS applications
• Knowledge of secure software development principles
• Experience with Datadog for monitoring, observability, and alerting.
• Experience operating data platforms in production environments.
• Knowledge of platform monitoring, capacity planning, and operational excellence practices.

What We Look For -- Our Values

• We seek out individuals who are always looking for new ways to improve or do things differently.
• We expect you to be proactive and be prepared to share open and honest feedback regularly.
• We know that working collaboratively will help us reach our shared goals faster, so we always look for similar individuals who will be willing to help others.
• Whether it is our customers, our markets, or each other, we like people to ask questions and listen to the answers so we can all learn and improve.
• We expect individuals to take responsibility for their actions and make decisions based on what is right for people, profit and planet.

Equal Employment Opportunity Statement

Individuals seeking employment at Camlin are considered without regards to race, colour, religion, national origin, age, sex, marital states, ancestry, physical or mental disability, gender identity or sexual orientation.