DATA ENGINEER
Descrição da oferta de emprego
Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations.
In this project you will be able to contact with one of the key players in banking in the EU and around the world.
Thus, you will be part of a multicultural team that is spread across more than 50 countries and you will help develop solutions in one of these three areas.
investments, business solutions or commercial/personal services.
We are looking for a Data Engineer to work in this project in Lisbon.
Requirements.
- 1+ years of experience in a similar position; - Proficiency in Python, and SQL Querys; - Good understanding of data modelling, data structures, and data management; - Knowledge on Apache Spark, Apache Hadoop, Airflow, Presto and Apache Drill is a plus; - Experience creating data sources on Data Visualization tools like Tableau or PowerBI; - Fluent in English.
Responsibilities.
- Design and maintain scalable and robust big data processing infrastructure, including data pipelines and ETL workflows; - Design data ingestion pipelines to gather data from various sources such as databases, APIs and files; - Design data processing pipelines to clean, filter and pre-process data for analysis; - Setup and manage distributed computing clusters and frameworks to ensure efficient data processing and analytics; - Implement and optimize secure data storage solutions to accommodate large volumes of structured and unstructured data; - Optimize data pipelines, framework code, cluster utilization and configuration to ensure the best performance from pipelines; - Design, maintain and enforce data governance and data catalogue; - Maintain a coherent documentation of the framework, cluster and projects; - Collaborate with data scientists, data analysts and stakeholders; - Evaluate and recommend new tools, frameworks and techniques to improve data engineering projects and platform; - Work in a continuous development framework with iterative deliveries, respecting deadlines and actively following tasks.
We offer.
- Health insurance; - A personalized training plan, with a budget to spend on the training and technical books you find necessary; - Constant feedback so you can grow professionally; - Remote onboarding process; - Team events every semester so you can live new adventures; - Culture of proximity and transparency.
Your ideas and needs are heard and valued by us! Apply If the above sounds like the kind of job opportunity you would want to get involved with, then please do not hesitate to apply here.
You can also explore our content about the job market here.
Detalhes da oferta
- Dellent
- Indeterminado
- 18/04/2024
- 17/07/2024
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Devops engineer location: carnaxide, lisbon, portugal, occupation: full time min... com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · demonstrable experience and skills in designing and implementing performance......
A vertente humana, empresa de recrutamento e seleção, trabalho temporário, formação e outsourcing, em grande expansão no seu sector de atividade, e a operar na área da gestão integral de recursos humanos, encontra-se a recrutar para empresa cliente de prestígio, budget & market engineer (m/f) em lourosa......
Job missionbiosurfit is looking for a talented engineer to join its research and development team... biosurfit is a portuguese diagnostics company focused on the development and manufacture of ivd tests for the point-of-care market with highly innovative proprietary technology and dedicated to the provision......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
As a candidate you’ve decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information... required skills and experience: being a big......
