DATA ENGINEER

Do you know AskBlue? We were born in , and we provide services in the field of information technology.
We are looking for Data Engineer  to join our company in one of our projects, in Lisbon.
Main Responsibilities.
•    Design and maintain scalable and robust big data processing infrastructure, including data pipelines and ETL workflows;                                                                •    Design data ingestion pipelines to gather data from various sources such as databases, APIs and files; •    Design data processing pipelines to clean, filter and pre-process data for analysis;                                        •    Setup and manage distributed computing clusters and frameworks to ensure efficient data processing and analytics; •    Implement and optimize secure data storage solutions to accommodate large volumes of structured and unstructured data;                                                                       •    Optimize data pipelines, framework code, cluster utilization and configuration to ensure the best performance from pipelines; •    Design, maintain and enforce data governance and data catalogue; •    Maintain a coherent documentation of the framework, cluster and projects; •    Collaborate with data scientists, data analysts and stakeholders to elicit data requirements and deliver effective solutions; •    Communicate complex technical concepts to non-technical stakeholders effectively; •    Evaluate and recommend new tools, frameworks and techniques to improve our data engineering projects and platform; and •    Work in a continuous development framework with iterative deliveries, respecting deadlines and actively following tasks.
Technical Skills.
•    Bachelor’s or Master’s degree in Computer Science, Software Engineering or a related field;                                              •    1+ years of experience as a Software Engineer, Back-End Software Engineer or Data Engineer; •    Strong proficiency in Python (proven experience developing data-related Python frameworks); •    Solid Software Development fundamentals; •    Proficiency in SQL queries and a good understanding of database architecture;                                             •    Strong analytical skills to ensure data quality and to know how to develop automated quality checks; •    Good understanding of data modelling, data structures, data management and best practices; •    Solid understanding of distributed computing principles and parallel processing; •    Excellent communication skills and the ability to work effectively in a collaborative and multi-cultural team environment; •    Knowledge on Apache Spark, Apache Hadoop, Airflow, Presto and Apache Drill is a plus; •    Familiarity with in-house big data platforms is a plus; •    Experience creating data sources on Data Visualization tools like Tableau and PowerBI is a plus (as well as being able to perform exploratory analysis).
Soft Skills.
•    Be driven, enthusiastic and dynamic in search of improving processes, controls & procedure.
Language Skills.
•    Fluency in English.
Offer.
•    Health Insurance; •    3 and a half days of leave per year + 22 vacation days; •    Unlimited access to Udemy.
•    If you are interested in the opportunity, upload your C.
.
or send it to with the reference # in the subject.
AskBlue - Business & Technology