SENIOR DATA ENGINEER
Descrição da oferta de emprego
This team focuses on using smartphone sensor data (location, accelerometer, gyroscope) to determine driving events (braking, acceleration, turning), trajectories, driving scores and related insights for cars and motorcycles.
Data Engineers in this team work on data processing pipelines (implemented as a queue-based microservices environment), on data storage & management (Postgres, Druid, AWS S3) and on data integration.
They maintain the services they deploy themselves using infrastructure and tooling provided by the Cloud Platform team.
They work closely with Data Scientists on the same team to deploy new AI/ML models into the pipelines and to support analytics efforts.
Responsibilities.
Our ideal candidate has been a key player in the design, development and deployment of at least one distributed, data-centric system and will continue to build such systems at Sentiance.
This includes.
Requirements definition and refinement System/software architecture and design Developing scalable, production-ready software components and data processing pipelines Set up and maintain SQL/NoSQL databases Set up CI/CD pipelines Performance and stability engineering Manage test and rollout plans Coach other developers Qualifications Must-Have Skills.
Minimum of 6 years of relevant experience as a Data Engineer or Software Engineer in a similar role.
Proficiency in data analysis, data processing, and data modeling.
Familiarity with cloud-based data platforms, such as AWS, Azure, or Google Cloud.
Strong programming skills, including proficiency in Java and Python.
Proficient with SQL or NoSQL databases Strong understanding of real time streaming technologies, for example Spark or Kafka.
Knows how to ship in Docker containers Good-to-Have.
Experience with technical leadership and build up technical direction.
Experience in setting up CI/CD pipelines Experience with large scale ETL processes for purposes like backups, internal tooling and ML pipelines.
Experience with IaC (infrastructure as code) Soft Skills Requirements.
Team-oriented Collaborative Self-starter/inner drive Independently and takes ownership Has a good sense of urgency
Detalhes da oferta
- Indeterminado
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 26/04/2024
- 25/07/2024
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Devops engineer location: carnaxide, lisbon, portugal, occupation: full time min... com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns......
Voxelmaps is recruiting senior fullstack developers to join a growing r&d; team focused on lidar, 3d, and advanced geospatial data processing... this team of developers will work on voxelmaps 3d/4d data processing platform and visualization tools... voxelmap’s mission is to build a true 4d volumetric......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
Mínimo de 5 anos de experiência... se gostas de relacionar-te com clientes e ambicionas trabalhar numa empresa que dá valor ao desenvolvimento profissional, formação e planos de carreira personalizados, candidata-te e junta-te ao estilo de vida #stepers!função: funcional sénior salesforceo que oferecemos:•......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · proactively identify additional test automation opportunities and analyse......
We are looking for a sap mm senior with the following requirements: requisitos do trabalho requeriments:• s/4hana implementations... on-site presence mandatory during design phase;local: híbrido/lisboa... descrição:equação it is a company focused on boosting technology and solid solutions through our......
A vertente humana, empresa de recrutamento e seleção, trabalho temporário, formação e outsourcing, em grande expansão no seu sector de atividade, e a operar na área da gestão integral de recursos humanos, encontra-se a recrutar para empresa cliente de prestígio, budget & market engineer (m/f) em lourosa......
