Data Engineer III

Description

The role is a Data Engineer III based in Bentonville, Arkansas, at 811 Excellence Dr., Bentonville, AR 72716.

The work covers analytics, big data analytics and automation aimed at business problems in your area, with some single-function problems handled independently.

Your work includes data pipelines, data models, data governance support and code delivery, and you will guide less experienced programmers.

Responsibilities

• Find options for business problems in your discipline using analytics, big data analytics and automation, and help build business cases and recommendations.
• Own delivery of your project work and of tasks assigned to you by others, and support process changes and updates.
• Help document and put into practice data governance processes, and apply the defined strategy to routine single-function problems.
• Extract data from identified databases and build pipelines that reshape it into a structure suited to the problem, choosing suitable techniques.
• Keep up with current data science and analytics trends, and help set priorities for requirements and service level agreements.
• Pick the most suitable fit-for-purpose data source and run first-pass data quality checks on extracted data.
• Analyze complex data elements, systems, data flows, dependencies and relationships to contribute to conceptual, logical and physical data models.
• Build logical and physical data models, including data warehouse and data mart designs, with relational tables, primary and foreign keys and stored procedures.
• Review existing data models and physical databases for differences and discrepancies, and build efficient data flows.
• Work out data-related system integration problems and propose fixes, and create training material and train end users on data modeling.
• Direct the work of less experienced programmers and set out troubleshooting support for systems.
• Write code for the solution and application features, choosing the language based on business, technical and data requirements.
• Write test cases to review and validate proposed designs, build proofs of concept, test code with a suitable approach, and deploy software to production servers.
• Document code, maintain playbooks and give regular progress updates.
• Stay current in your field and use that knowledge to plan, carry out and improve action plans, advising others on information and best practices, aligning work with customer and business needs, and building agreement on viewpoints and reasoning.

Requirements

• Master's degree or equivalent in Computer Science, Engineering (any) or a related field, or a Bachelor's degree or equivalent in one of those fields plus 2 years of software engineering or related experience.
• Experience analyzing business requirements, performing data analysis and writing technical design documents with product and data teams.
• Experience designing and building scalable, distributed data pipelines and ETL solutions with Spark, Hadoop, Hive, Azure Databricks, Azure Data Factory, Azure Blob Storage, GCP Dataproc and BigQuery.
• Experience writing high-quality object-oriented code in Python and Scala that follows industry best practices.
• Experience automating workflows with Python and shell scripting, and building lightweight ETL frameworks.
• Experience tuning Spark Core, Spark SQL and Spark Streaming applications for better performance and lower cost.
• Experience building data pipelines on Microsoft Azure, Databricks, Google Cloud Platform and BigQuery.
• Experience orchestrating workflows with Apache Airflow, Azure Data Factory, GCP Cloud Composer, Automic and Oozie.
• Experience setting up CI/CD pipelines with GitHub, Jenkins, JFrog and Artifactory.
• Experience managing code with Git, including collaboration, code review and release management.
• Experience writing optimized SQL for extraction, transformation and warehousing in Hive and BigQuery.
• Experience delivering scalable data solutions on time with cross-functional teams.
• Experience applying Agile and Waterfall methods depending on project needs.
• Experience designing data models across RDBMS and cloud systems for efficient access and analytics.
• No minimum amount of experience is required beyond the listed skills.

Conditions

Pay is $110,302.00 to $180,000.00 per year.

Performance incentives are paid annually or quarterly.

The location is 811 Excellence Dr., Bentonville, AR 72716.

The company is an equal opportunity employer.

The company maintains a drug-free workplace with a zero-tolerance policy on illegal drugs and alcohol on the job.

Benefits

• Competitive pay with performance-based incentive awards.
• Health coverage with medical, vision and dental plans.
• Financial benefits including a 401(k), stock purchase plan and company-paid life insurance.
• Paid time off covering PTO with sick leave, parental leave, family care leave, bereavement, jury duty and voting.
• Short-term and long-term disability cover, education assistance with 100% company-paid college degrees, company discounts, military service pay and adoption expense reimbursement.
• Some benefits depend on job classification and length of employment, and plan terms may change. Details are on the company's benefits site.