Logo ALDIA
ALDIA
Full time

Data Engineer

ALDIA

馃搷 Location
Madrid (Spain)
馃挵 Salary
40-45K
馃捈 Experience
5 years minimum

About us

At ALDIA, you will be part of a global team specializing in international projects, fostering inclusion and diversity, gender equality, and a work environment built on respect and dignity for everyone.
Are you passionate about technology and enjoy working in a collaborative and challenging environment? We'd love to hear from you!

Job description

ALDIA is looking for a Data Engineer to design, build and maintain efficient, scalable and robust data pipelines.

The role focuses on data engineering and analytics projects in a dynamic environment.

MISSIONS
- Develop pipelines, orchestration and cloud technologies.
- Design, schedule and maintain DAGs in Apache Airflow for automated ingestion of batch and near real-time data flows.
- Use the Google Cloud Platform (GCP) ecosystem for cloud analytics solutions, with a focus on large-scale storage and processing.
- Manage data warehouses with BigQuery.
- Transform and model data with Dataform to manage versioned and tested SQL transformations.
- Develop modular, clean and reusable Python code for data processing, cleaning and manipulation, integrating APIs and heterogeneous sources.
- Data architecture, modeling and best practices
- Define and build optimized data schemas, including star, snowflake and Data Vault models, oriented toward analysis, reporting and consumption by data scientists and business analysts.
- Apply software development best practices, including version control, continuous integration, data testing, clear documentation and query performance and cost optimization.
- Implement automatic controls to ensure data integrity, consistency and reliability throughout the data lifecycle.
- Soft skills and teamwork
- Work with analytical and infrastructure challenges using independent judgment, identifying bottlenecks and proposing end-to-end solutions.
- Anticipate team needs, propose continuous improvements to the existing architecture and stay up to date with best practices in the field.
- Ask the right questions, clarify business requirements with stakeholders and interact actively with technical profiles such as Data Scientists and Data Analysts.

ORGANISATION
- The candidate will join the data team.
- The team promotes a culture of continuous learning and the application of data engineering best practices.
- The environment involves constant challenges in designing and implementing modern cloud analytics architectures.

Required qualifications

- Design and maintenance of DAGs
- Batch and near real-time data ingestion
- Cloud analytics solutions
- Large-scale storage and processing
- Data warehousing
- Data transformation and modeling
- Versioned and tested SQL transformations
- Modular, clean and reusable code development
- Data processing, cleaning and manipulation
- Integration of APIs and heterogeneous sources
- Data modeling with star, snowflake and Data Vault schemas
- Continuous integration
- Data testing
- Documentation
- Query performance and cost optimization
- Automatic data quality controls
- Data integrity, consistency and reliability across the data lifecycle


- Apache Airflow
- Google Cloud Platform (GCP)
- BigQuery
- Dataform
- Python
- Git

SOFT SKILLS
- High proactivity
- Autonomy
- Initiative
- Ability to collaborate actively with the team
- Ability to ask relevant questions
- Ability to clarify business requirements with stakeholders
- Ability to work independently on complex problems
- Problem-solving mindset
- Ability to identify bottlenecks
- Ability to propose end-to-end solutions
- Continuous improvement mindset
- Ability to stay up to date with industry best practices
- Effective communication

Interested in this job?

Send your application below, our recruitment team will get back to you quickly.

馃挰 Personalize your message to the recruiter, click here!

By clicking Apply, I accept that the information entered will be transmitted to the recruiter and used for the purpose of managing applications. In accordance with the "Informatique et Libert茅s" law, you can exercise your right of access to your data and have it corrected by contacting us: jobposting.pro/contact
Learn more about our data protection policy.

Full time 路 Data Engineer 馃搷Madrid 路 馃挵40-45K
Apply