Senior Databricks Data Engineer 

Valcon helps customers in their journey to become more data driven and to create mature data solutions. As part of helping customers accelerate their data strategy, one of our core strengths is designing and implementing data platforms.  Since many of our customers use substantial amounts of data, we were amongst the first to utilize the power of Spark and Delta Lake. Both these open-source techniques were designed by the same people that started Databricks. Valcon has a long history of applying Databricks technology in their data related projects.  

   

Since we often use Databricks technology on our projects, we started building up a community of Databricks craftsman within Valcon, consisting of Data Engineers, Data Scientists and Data Management experts. This with the intent to build a network of data experts that can learn from each other and create best practices.  

 

The cooperation with Databricks and the amount of effort we put in to have people certified on the technology, has led to the fact that Valcon became the first local Elite partner of Databricks in the Benelux.   

  

Since the number of customers where we utilize Databricks is still growing, we are searching for motivated and well qualified people. People that have more than 5 years of experience working in the industry as a data engineer and gained extensive (at least 2 years) experience with Databricks. We also welcome people that have worked with the open-source variants of Spark and Delta.   

  

At Valcon you work together in a multidisciplinary team with business consultants, software developers and technical specialists. We like to go the extra mile for a good result and high quality. This results in solutions that make the difference and result in satisfied clients and happy end-users.  

What are you going to do?

As a Databricks Engineer at Valcon, your primary responsibility will be leveraging cutting-edge data engineering techniques and methodologies (like MLOps)to facilitate informed business decisions for our clients. Your role entails the collection, aggregation, analysis, and processing of both structured and unstructured data from various internal and external sources, thereby empowering decision-makers with accessible data insights. Your ultimate objective is to enable our clients to achieve their business goals through data-driven strategies.  

You lead the development of robust data pipelines, collaborating with cross-functional teams to design end-to-end solutions for sophisticated data products. As a vital link in the data supply chain, you will ensure that stakeholders have seamless access to manipulation capabilities for data, facilitating both routine and ad hoc analysis through a modern data platform.  

 

Valcon maintains a superb portfolio of clients that are at the forefront of the digital revolution towards ubiquitous AI in their businesses, you will have the chance to be part of one of these groundbreaking projects.  

As a Databricks Engineer at Valcon you will also have access to some of the best Data & AI minds in the business, both by working with our excellent internal teams as well as close collaboration with Databricks.  

Your proficiency spans on-premises and cloud environments, showcasing a deep understanding of evolving technologies. Coding isn’t just a skill; it’s a natural part of your toolkit as you navigate the digital realm with ease.  

 

Beyond technical competency, your strategic mindset guides the team toward sustainable and scalable solutions. Concepts like Agile, CI/CD, and IaC are integral to your approach, ensuring a seamless integration of technology and business objectives.  

 

In this leadership role, you’re not just managing data; you’re architecting transformative solutions, leveraging your extensive experience to drive the organization toward new heights of data-driven excellence.  

Responsibilities

  • Design and build the next-generation of data platforms that support Data & AI initiatives  

  • Setting up cloud OTAP environments for platforms such as Azure, AWS and GCP.  

  • Familiar with data modeling techniques: Dimensional and Relational modelling, Data Vault.  

  • Ability to help grow our presence with new and existing customers.  

  • Training and guiding business consultants and junior developers in the application of cloud technology.  

  • Co-developing Valcon’s Cloud proposition.  

  • Building and maintaining a relevant network inside and outside of the organization.  

Valcon core values

  • Can do
  • Together
  • Curiosity
  • Integrity
  • Joy

We offer

  • An energetic, ambitious and international environment with a great working atmosphere.
  • An environment with significant autonomy and responsibility.
  • A steep learning curve and structured coaching from your own mentor.
  • A thriving community, active in both business and social events.
  • Market relevant employment package (salary, benefits fund, bonus, lease car or mobility allowance and laptop).

Experience

  • A completed technical WO or HBO education with WO thinking and working level. 
  • Minimum 5 years of work experience as a (Lead) Data Engineer. 
  • A minimum of 2 years working with Databricks technology, including Spark and Delta Lake
  • Strong in a team with good communication, analytical and leadership skills. 
  • Experience with Cloud platforms (e.g. Azure, AWS or GCP). Preferably with certifications.
  • Experience with the following technologies or methods is an advantage: Pyspark, SQL, Python, data pipelines, API’s, Agile, Scrum, DevOps, data architecture, data storytelling, Infrastructure-as-Code and ML-Ops.
  • Fluent in Dutch and English 

Keywords

  • Databricks, Pyspark, Github, Solution Architecture, Data Engineering

Location

Netherlands

Senior Databricks Data Engineer 

    Job Primary Location: Netherlands