Share this
Job Title: Lead Data Engineer (Data Warehousing)
Industry: Commodity Trading
Location: London, Onsite
Salary: £750 per day (Inside IR35)
Duration: 6 Months Rolling
Job Description:
The Lead Data Engineer will lead the design and development of a strategic data warehouse to store data. This role involves collaboration with business users, refining requirements, implementing efficient ETL pipelines and data storage solutions. The ideal candidate will drive innovation, optimize processes within the data ecosystem, and provide technical mentoring to junior staff.
Key Responsibilities:
- Collaborate with business users to gather and refine requirements
- Design and implement robust ETL pipelines and data storage solutions
- Evaluate and select the appropriate technologies and tools for building the data warehouse
- Drive innovation and identify opportunities for optimization and automation
- Provide technical mentoring and guidance to junior developers and engineers
Desired Technical Expertise:
- Extensive experience with object-oriented programming and software development lifecycle
- Strong expertise in data engineering, including data warehousing, ETL processes, and database design
- Proficiency in SQL and experience with various database technologies
- Knowledge of Java and Python, and the ability to build scalable solutions
- Experience with cloud platforms like AWS or Azure, particularly in data-related services
- Familiarity with DevOps practices and tools, including CI/CD pipelines
- Background in the commodities or financial services industry is highly advantageous
- Experience with big data technologies and distributed systems is beneficial
Non-Technical Skills:
- Strong leadership and collaboration skills
- Analytical mindset and excellent problem-solving abilities
- Proactive approach to learning and professional development
- Strong communication skills to convey complex technical concepts to non-technical stakeholders
Share this