Location: San Jose / Santa Clara, CA (Day 1 Onsite)
Contract
:
We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment.
Core Responsibilities
Design and Optimization:
Design, implement, and optimize
clean, well-structured, and performant analytical datasets
to support high-volume reporting, business analysis, and data science model development.
Pipeline Development:
Architect, build, and maintain
scalable and robust data pipelines
for diverse applications, including business intelligence, advanced analytics
Big Data & Streaming:
Implement and support
Big Data solutions
for both
batch
(scheduled) and
real-time/streaming
analytics.
Collaboration:
Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.
Required Skills & Experience
Cloud Platform Expertise (GCP Focus):
Extensive hands-on experience working in dynamic cloud environments, with a strong preference for
Google Cloud Platform (GCP)
services, specifically:
o
BigQuery:
Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
o Experience with other relevant GCP services like
Cloud Storage
,
Cloud Dataflow/Beam
, or
Pub/Sub
Programming & Querying:
o
Python:
Expert-level programming proficiency
in Python, including experience with relevant data engineering libraries
o
SQL:
A
solid command of advanced SQL
for complex querying, data processing, and performance tuning.
Data Pipeline Orchestration:
Prior experience using workflow management and orchestration tools (e.g.,
Apache Airflow
, Cloud Composer, Airflow,Dagster, or similar).
DevOps/CI/CD:
Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.
Required Skills
DEVOPS ENGINEER
SENIOR EMAIL SECURITY ENGINEER
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.