2 jobs found

Refine Search
Current Search
Hive Cloud Computing Data Architecture Data Management
Refine by Skills
Sep 02, 2024
Full-time
Data Engineer III
Walmart Sunnyvale, CA, USA
Duties: Build streaming pipelines using technologies such as Spark Streaming or Kafka. Develop data pipelines and processing layers using programming languages such as Scala and Python. Apply SQL and No-SQL database expertise to work with databases such as Cassandra, BigQuery, and Cosmos DB. Implement workflow management tool Airflow to optimize data processing. Develop enterprise data warehouses using technologies such as BigQuery. Run Spark and Hadoop workloads on platforms such as Dataproc to enhance data processing capabilities. Utilize Big Data technologies such as Spark, PySpark, Hive, and SQL to architect and design scalable, low-latency, and fault-tolerant data processing pipelines. Implement data governance practices, including data quality, metadata management, and security measures. Optimize complex queries across large datasets for efficient data processing. Leverage Kafka for data streaming and processing. Collaborate with...
May 04, 2020
Full-time
Senior Manager / Associate Director - Data Strategy & Governance
Gilead Sciences Foster City, CA, USA
This position is responsible for maintaining data sanctity by taking ownership of data management process across multiple systems and providing the business acumen to monitor data quality, maintaining business rules and providing cross-functional support on data management related projects. This role will be a trusted advisor to the commercial organization on everything data management. This role would also entail being the business owner of Cloud strategy and execution for the commercial operations group. Core job responsibilities include: Own data management work streams from end to end which includes fidelity in operations of data warehouse as well as governance process around it. Identify, prioritize and execute tools and capabilities needed for downstream users which includes analytics teams and other sales operations teams Lead cloud strategy from commercial operations team representing all commercial analytics teams Influence the design of the analytics...