Apply now »

Data Engineer with Databricks

Location: 

Warsaw, PL, 00-189

Cooperation Type:  Internal consultant (B2B)

 

At KMD, we build digital solutions used by millions of people around the world. These solutions are the digital foundations of our most important institutions, from governments and public services to financial industries and private companies. Our mission is to ensure that they are reliable, accessible, and efficient.

We believe that the future is what you make it. So a career at KMD is a career with purpose and freedom. One where you’ll have a direct hand in improving the lives of people, while being empowered with the resources and autonomy to shape the course of your own professional journey. 

Location: Warsaw (Inflancka 4A) or Remote Work (Poland) 
B2B Contract, Targeted Salary: 150 - 170 PLN Net/Hour 

 

#Python #ApacheSpark #Databricks #MSSQL #Git #CI/CD #Docker #Azure #Kubernetes

 

Are you ready to join our international team as a Data Engineer with Databricks? We shall tell you why you should...

 

What products do we develop?

 

KMD Elements is a cloud-based solution tailored for the energy and utility market. It offers a highly efficient way to handle complex data validation and advanced formula-based settlements on time series. Designed for the international market, KMD Elements automates intricate calculation and billing processes. Key features include an advanced configuration engine, robust automation capabilities, multiple integration options, and a customer-centric interface. More info can be found here

 

How do we work?


#Agile #Scrum #Teamwork #CleanCode #CodeReview #E2Eresponsibility #ConstantImprovement

 

Your responsibilities:

 

  • Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python.
  • Have end-to-end responsibility for the full lifecycle of features you develop.
  • Design technical solutions for business requirements from the product roadmap.
  • Ensure optimal performance
  • Refactor existing code and enhance system architecture to improve maintainability and scalability.
  • Design and evolve the test automation strategy, including technology stack and solution architecture.
  • Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.

 


Ideal candidate:  

 

  • Has 3+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT).
  • Is proficient in Python, with a solid understanding of data processing challenges.
  • Has experience working with Apache Spark and Databricks.
  • Is familiar with MSSQL databases or other relational databases.
  • Has some experience working with distributed systems on a cloud platform.
  • Has worked on large-scale systems and understands performance optimization.
  • Is comfortable with Git and CI/CD practices, and can contribute to deployment processes for data pipelines.
  • Is proactive, eager to learn, and has a strong can-do attitude.
  • Communicates fluently in English and Polish, both written and spoken.
  • Is a team player with excellent collaboration and communication skills.

 

Nice to Have:

 

  • Experience with Azure
  • Experience working with SSIS
  • Familiarity with Azure PostgreSQL
  • Knowledge of Docker and Kubernetes
  • Exposure to Kafka or other message brokers and event-driven architecture
  • Experience working in Agile/Scrum environments

 

 

Benefits:

 

KMD (an NEC company) is committed to providing equal opportunities. Hence, we invite all qualified interested applicants to apply for career opportunities. At KMD all aspects of employment and cooperation including the decision to hire/cooperate with will be based on merit, competence, performance, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other status protected under local anti-discrimination legislation.

Apply now »