Data Engineer

Management Consulting | Strategy & Analytics

San Jose, California, United States

Position Summary

Are you an experienced, passionate pioneer in technology? An industry solutions professional who wants to work in a collaborative environment. As an experienced Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel. If so, consider an opportunity with Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent model that is tailored specifically for long-term, onsite client service delivery.  PDM practitioners are local to project locations, minimizing extensive travel, and provides you with a full career path within the firm.

 

Work you’ll do/Responsibilities  

Work within clients Customer Insights team and using data and insights to drive subscriber growth in partnership with client's Growth, Promotion/Pricing, eCommerce, Payments, and digital trading teams. Opportunity to work with best-in-class data engineers, architects, visualization experts and leading-edge technologies. Overall team size is 26. Lead role with direct management of 6 resources (offshore)

  • Conduct requirement gathering and analysis, business logic alignment/development
  • Build data pipelines
  • Support Enhancement and Automation of existing data engineering pipelines
  • Build automation for existing pipelines and & Data Governance around them
  • Test, productionize, and document data pipelines
  • Support ongoing Monitoring & Support of data pipelines
  • Build modular pipelines to accommodate new product launches across geographic locations
  • Re-architect the platform to decouple analytical and operational workloads
  • Provide ongoing support for BI, Analytics & Visualization requirements for the business prioritized projects
  • Consolidate BI reports scattered across multiple tools and dashboards
  • Work directly with client and extended offshore team in delivery
  • Maintain and manage product backlog in JIRA

The Team 

As a part of the US Strategy & Analytics Offering Portfolio, the AI & Data Operations offering provides managed AI, Intelligent Automation, and Data DevOps services across the advise-implement-operate spectrum.

Qualifications

Required

  • Minimum six years experience in Data Engineering role
  • Proficient in Hadoop, Hive, Presto, SQL, Python, PySpark, Git, Jenkins, Air Flow, Rest APIs, Shell Scripting.
  • Experience in running SparkSQL, PySpark in AWS EMR environment (SQL and Python are implicit).
  • Strong Communication skills Verbal and Written
  • Ability to interact directly with client and lead a small team in onshore/offshore model
  • Must be able to sit on site in San Jose, CA
  • Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience
  • Limited immigration sponsorship may be available
  • Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve

Preferred

  • Data Bricks on Azure, AWS EMR, AWS RD
  • Exposure to other AWS services i.e. Redshift, Athena
  • Cassandra, Kafka, PowerApps, Elastic Search.
  • Power BI/Tableau


        For individuals assigned and/or hired to work in California, Colorado, Jersey City, Nevada, New York City, and Washington State, Deloitte is required by law to include a reasonable estimate of the compensation range for this role. This compensation range is specific to California, Colorado, Jersey City, Nevada, New York City, and Washington State and takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.  At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.  A reasonable estimate of the current range is $114,000 to $190,000. 

Our people and culture

Our diverse, equitable, and inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our client most complex challenges. This makes Deloitte one of the most rewarding places to work. Learn more about our inclusive culture.

Professional development

From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship. From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career.


As used in this posting, "Deloitte" means Deloitte Consulting LLP, a subsidiary of Deloitte LLP. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.

Requisition code: 131454

SCAM ALERT

Caution against fraudulent job offers!

We have been informed of instances where jobseekers are led to believe of fictitious job opportunities with Deloitte US (“Deloitte”). In one or more such cases, false promises of actual or potential selection, or initiation or completion of the recruitment formalities appear to have been or are being made. Some jobseekers appear to have been asked to pay money to specified bank accounts of individuals or entities as a condition of their selection for a ‘job’ with Deloitte. These individuals or entities are in no way connected with Deloitte and do not represent or otherwise act on behalf of Deloitte.

We would like to clarify that:

  • At Deloitte, ethics and integrity are fundamental and not negotiable.
  • We are against corruption and neither offer bribes nor accept them, nor induce or permit any other party to make or receive bribes on our behalf.
  • We have not authorized any party or person to collect any money from jobseekers in any form whatsoever for promises of getting jobs in Deloitte.
  • We consider candidates on merit and that we provide an equal opportunity to eligible applicants.
  • No one other than designated Deloitte personnel (e.g., a Deloitte recruiter or Deloitte hiring partner) is permitted to extend any job offer from Deloitte.

Anyone who at any time has made or makes any payment to any party in exchange for promises of job or selection for a job with Deloitte or any matter related to this (including those for ‘registration’, ‘verification’ or ‘security deposit’) or otherwise engages with any such person who has made or makes fraudulent promises or offers, does so (or has done so) entirely at their own risk. Deloitte takes no responsibility or liability for any such unauthorized or fraudulent actions or engagements. We encourage jobseekers to exercise caution.