Sr. Data Engineer


$45.00

We're seeking a Senior Data Engineer to design and implement robust data infrastructure that powers AI systems. You'll build scalable data pipelines and storage solutions while ensuring data security and compliance. You'll collaborate with data scientists and analysts to enable efficient data access and processing. Responsibilities: Design, develop, and maintain scalable etl/elt pipelines for processing large datasets build and optimize data storage solutions (data warehouses, data lakes, etc.) Work with relational and NoSQL databases to ensure data integrity and performance Automate workflows using Apache Airflow, Prefect, or similar tools Ensure data security, governance, and compliance (gdpr, hipaa, etc.) Collaborate with data scientists and analysts to enable efficient data access Work with cloud platforms (AWS, Azure, GCP) for scalable data solutions Requirements: 5+ years of experience in data engineering, big data processing, or software development Strong programming skills in Python, SQL, or Scala Experience with ETL tools (dbt, Apache NiFi, Talend, etc.) Knowledge of database systems (PostgreSQL, MySQL, Snowflake, Redshift, BigQuery, etc.) Experience with cloud services (AWS S3, Lambda, Glue, Azure Data Factory, GCP BigQuery) Familiarity with data modeling and schema design Understanding of distributed computing frameworks (Hadoop, Spark, etc.) Apply Now!!Category: IT & ProgrammingSubcategory: Data ScienceIs this a project or a position?: ProjectRequired availability: Full time

Keyword: SQL

Price: $45.0

Amazon Web Services (AWS) Data Warehousing Microsoft Azure Python SQL Google Cloud Platform (GCP) Apache Hadoop Data Science Extract Transform Load (ETL)

 

Transfer site to windows server 2019

N/D

View Job
Programación en Vb.net y manejo de Sql

Programación en VB.net y manejo de SQL. Crear una base de datos sql, abrir múltiples puertos (máximo 20 socket), recibir datos y almacenarlos en la base de datos sql. Si algún puerto se cae, intentar reabrilo y continuar leyendo, sin afectar el funcionamiento del resto ...

View Job
Security Assessment & Vulnerability Analysis for .NET Core & Angular Application

We're seeking an experienced security professional to conduct a comprehensive security assessment of our healthcare web application built on .NET Core 6 backend with Angular 14 frontend. This project requires static code scanning, vulnerability analysis using Burp Suite...

View Job