AZURE DATABRICKS DATA ENGINEER
Descrição da oferta de emprego
• candidates with an experience of 5-7 yrs.
• Senior Azure Databricks Data Engineer having more than 7+ yrs.
of experience.
• Have good technical experience and expertise in Python, PySpark, SQL and Data warehousing concepts.
• Strong experience and expertise in Azure Databricks, Python & PySpark for data processing and transformation is a must.
• Good experience in data engineering to create pipelines for various clients to build end to end solutions using distributed computing frameworks and ETL tools.
Creating data pipelines from a Modeling, Design and Coding point of view.
• Experience and familiarity with Azure services such as Synapse Azure Functions Monitors ADLS Data Lakehouse Medallion Architecture etc.
• Good experience working with streaming and incremental workloads using Delta Live Tables, Unity Catalog.
• Good experience in dealing with SCD data with the incremental loads to accommodate updated to the data.
• Solid understanding of data warehousing concepts and architectures.
• Good knowledge in SQL to write complex queries in order to achieve client’s requirements.
• Good knowledge about data modeling techniques (3NF, Dimensional Modelling, Data Vault).
• Good knowledge about agile, scrum way of working.
• Pro-active, can-do mindset and used to collaborate met business stakeholders.
• Strong problem-solving and communication skills.
Skills.
Agile Architecture Data Engineering Python Test Design What you can expect from us.
Insights you can act on While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business success.
When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes.
We call our employees “members” because they are CGI shareholders and owners, and, as owners, we enjoy working and growing together to build a company we are proud of.
This has been our Dream since , and it has brought us to where we are today—one of the world’s largest independent providers of IT and business consulting services.
At CGI, we recognize the richness that diversity brings.
We strive to create a work culture where everyone belongs, and we collaborate with clients in building more inclusive communities.
As an equal opportunity employer, we empower all our members to succeed and grow.
If you require an accommodation at any point during the recruitment process, please let us know.
We will be happy to assist.
Ready to become part of our success story? Join CGI—where your ideas and actions make a difference.
Detalhes da oferta
- CGI
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 27/03/2024
- 25/06/2024
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Devops engineer location: carnaxide, lisbon, portugal, occupation: full time min... com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · involve in product design to guarantee adherence of test coverage for......
A vertente humana, empresa de recrutamento e seleção, trabalho temporário, formação e outsourcing, em grande expansão no seu sector de atividade, e a operar na área da gestão integral de recursos humanos, encontra-se a recrutar para empresa cliente de prestígio, budget & market engineer (m/f) em lourosa......
Job missionbiosurfit is looking for a talented engineer to join its research and development team... workplace: azambujasend c... additionally, the company created an online platform dedicated to the online commerce of products from supplements, self-tests, non-prescription medicines (mnsrm) and others......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Licenciatura ou mestrado na área das tecnologias de informação ou equivalente; experiência como business intelligence consultant, de pelo menos 5 anos; conhecimentos sólidos nas várias camadas / fases de projetos de business intelligence (requisitos, modelação, etl, data visualization); experiência em......
