About us
ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies. Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce. We deliver our services both in fixed-price and time-and-materials models, helping our customers achieve their business and IT strategies.
Job Description
We are seeking a Senior Data / Big Data Engineer for a banking project to deliver complex solutions, guide the platform's data strategy, define standards, and support team development.
Responsibilities:
- Design and develop custom data pipelines for batch and near-real-time processing.
- Ingest data from diverse sources and debug platform/application errors.
- Optimize performance over Avro and Parquet on HDFS, including partitioning and bucketing.
- Debug Spark and Impala sessions (SHS, Impala).
- Design secure data solutions following security-by-design principles.
- Monitor Big Data applications using Kafka, InfluxDB, Grafana.
- Perform DevOps tasks: CI/CD with Jenkins, version control with Git/SVN.
- Create documentation and standardize procedures.
- Mentor junior colleagues and transfer technical know-how.
- Contribute to the long-term data strategy of the platform.
Required qualifications
- Strong experience with the Cloudera Hadoop stack: HDFS, Hive Metastore, Impala, Spark.
- Advanced SQL skills and scripting experience in Bash, Python, PowerShell.
- Experience in Linux production environments.
- Familiarity with Airflow, Informatica, NiFi.
- Proven ability to independently design complex data solutions.
- Communicative, systematic, and responsible with strong team collaboration skills.
Nice to Have:
- Experience with Databricks – Data Engineering.
- Exposure to Azure Data Stack (Data Factory, ADLS, Synapse, etc.)
