DATA ENGINEER
Descrição da oferta de emprego
Be part of the team that combines business knowledge technological edge and a design experience.
Our different backgrounds and knowhow are key in developing solutions and experiences for digital clients.
Face challenges and learn other ways of thinking and seeing the world theres always room for your energy and creativity.
About the role Data Engineer is responsible for building and maintaining Data Platforms.
Recognizes the importance of data for the organization in the areas where it is the key to success.
Ensures that these success factors are being realized in the best possible way.
Maintaining an eye on the big picture and knowing the details of the business are decisive for this role.
This role is focused on designing developing and maintaining the data platform required for data storage processing orchestration and analysis.
Their mission involves implementing scalable and performant data pipelines and data integration solutions.
Agnostic of data sources and technologies to ensure efficient data flow and high data quality enabling data scientists analysts and other stakeholders to access and analyze data effectively.
As a part of your job you will.
Design build and maintain scalable data platforms; Collect process and analyze large and complex data sets from various sources; Develop and implement data processing workflows using data processing framework technologies such as Spark and Apache Beam; Collaborate with crossfunctional teams to ensure data accuracy and integrity; Ensure data security and privacy through proper implementation of access controls and data encryption; Extraction of data from various sources including databases file systems and APIs; Monitor system performance and optimize for high availability and scalability.
What are we looking for Proficiency in programming languages like Python Java or Scala; Use of Big Data Tools such as Spark Flink Kafka Elastic Search Hadoop Hive Sqoop Flume Impala Kafka Streams and Connect Druid etc.; Knowledge of data modeling and database design principles; Familiarity with data integration and ETL tools (e.
.
Apache Kafka Talend); Understanding of distributed systems and data processing architectures; Strong SQL skills and experience with relational and NoSQL databases; Familiarity with cloud platforms and services for data engineering (e.
.
AWS S3 Azure Data Factory); Experience with version control tools such as Git.
Personal traits.
Ability to adapt to different contexts teams and Clients; Teamwork skills but also a sense of autonomy; Motivation for international projects and ok if travel is included; Willingness to collaborate with other players; Strong communication skills.
We want people who like to roll up their sleeves and open their minds.
Believe this is you Come join the Team!
Detalhes da oferta
- Celfocus
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 12/04/2024
- 11/07/2024
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Devops engineer location: carnaxide, lisbon, portugal, occupation: full time min... com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · involve in product design to guarantee adherence of test coverage for......
A vertente humana, empresa de recrutamento e seleção, trabalho temporário, formação e outsourcing, em grande expansão no seu sector de atividade, e a operar na área da gestão integral de recursos humanos, encontra-se a recrutar para empresa cliente de prestígio, budget & market engineer (m/f) em lourosa......
Job missionbiosurfit is looking for a talented engineer to join its research and development team... workplace: azambujasend c... additionally, the company created an online platform dedicated to the online commerce of products from supplements, self-tests, non-prescription medicines (mnsrm) and others......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
As a candidate you’ve decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information... required skills and experience: being a big......
