DATA BRICKS SPECIALIST NEED
Descrição da oferta de emprego
I need a document that builds the solution architecture based on the below requirements 1.
Receive data from various data sources (min 3 and max 16)in the form of csv and txt files.
Each source sends multiple files (up to 10) at different frequencies, volume and format 2.
Build a data lake that performs data validations, standardization, transformations in a scalable manner Identify and report different errors (process and data) that a data engineer can use to notify data owners and take necessary action 3.
Delineate and secure each data source so that data is not intermingled 4.
Build a generic pipeline that is easy to use, configurable, extensible and scalable across data sources that can process up to 1 TB file size everyday Ideal Candidate.
- Proven experience with Databricks - Comfortable with a variety of data sources, including but not limited to relational databases, CSV files and API integrations - The ability to generate comprehensive project proposals Apache Data Integration Processamento de dados Powerpoint PySpark ID do Projeto.
# Sobre o projeto 7 propostas Aberto para ofertas Projeto remoto Ativo em 3 horas atrás
Detalhes da oferta
- Indeterminado
- Em todo Portugal
- Indeterminado - Indeterminado
- 04/04/2024
- 03/07/2024
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Serve as an escalation point for major escalated service delivery issues;• streamline existing business processes and implement modern technology to improve efficiencies;• support dhots in coordinating and ensuring the delivery of integrated related project streams;• perform any other related duties......
We're selecting call center operator (m/f) for a company in the services sector located in porto... this position provides customer service support and resolution of routine problems regarding client's product or services... job description: interfaces with customers via inbound calls, outbound calls......
We are looking for dynamic and passionate individuals, fluent in different languages, to join our team, provide an amazing experience for all our clients and ensure a positive workplace environment... all necessary equipment will be provided by the company... nice-to-have: 6 months’ experience in a technical......
We are big on team spirit, and that's why you'll work closely with the other departments of the company to be able to give our customers the best service and to increase customer satisfaction and loyalty... requisitos do trabalho you are fluent in italian and english (written & spoken) and have an understandable......
Responsibilities: you are the first point of contact for our customers and provide advice to their requests regarding their bookings, rental agreements, complaints, and invoices... our client is looking to expand their team in lisbon, to deliver premium service to french speaking customers......
Com/careers/full-stack-software-developer-java/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information......
As a candidate you’ve decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information... required skills and experience: being a big......
What you will need to succeed:native command of ukrainian;fluency in english (min... they will need to be able to work under pressure and handle a fast-paced environment, as they will often be working on tight deadlines and may need to interpret simultaneously or consecutively......
Com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information......
