Data Engineer III

Description

The role is a Data Engineer III based in Bentonville, Arkansas (811 Excellence Dr, Bentonville, AR 72716).

The work centres on turning business problems into data solutions using analytics, big data analytics and automation, covering data pipelines, data models and production code.

Responsibilities

• Look at the business problems in your area and propose options that use analytics, big data analytics and automation.
• Help build business cases and recommendations, and take ownership of project work and tasks assigned to you by others.
• Support process changes and updates, and help resolve business issues.
• Help document and put into practice data governance processes.
• Apply the defined strategy to routine business problems that involve a single function.
• Pull data from the databases you are given and build pipelines that reshape it to fit the problem, choosing suitable techniques.
• Keep up with current data science and analytics trends.
• Help make sure requirements and service level agreements are prioritised correctly, and help identify the right data source for each purpose.
• Run initial data quality checks on extracted data.
• Analyse complex data elements, systems, data flows, dependencies and relationships to contribute to conceptual, logical and physical data models.
• Develop the logical and physical data models, including data warehouse and data mart designs.
• Define relational tables, primary and foreign keys, and stored procedures that form the data model.
• Review existing data models and physical databases for variances and discrepancies.
• Build efficient data flows and propose fixes for data-related system integration problems.
• Write training material and train end-users on data modelling.
• Oversee less experienced programmers and set out support steps for system troubleshooting.
• Write code for the required solution and application features, choosing the language that fits the business, technical and data requirements.
• Write test cases to review and validate proposed designs, build proofs of concept, test code with the right approach, and deploy software to production servers.
• Document code, maintain playbooks, and give timely progress updates.
• Stay current in your field and use that knowledge to build and improve action plans, advise and guide others on information and best practices, align work with customer and business needs, and build agreement around your views and reasoning.

Requirements

• A master's degree or equivalent in computer science or a related field, or a bachelor's degree or equivalent in computer science or a related field plus 2 years of experience in software engineering or a related field.
• Hands-on experience designing and building dataflows in Google Cloud Platform.
• Experience coding in Scala and in object-oriented Python.
• Experience designing and building a data warehouse in BigQuery.
• Experience building data pipelines and handling ad hoc analysis requests with Apache Spark and PySpark.
• Experience writing SQL-style queries and building pipelines on Google Cloud Storage buckets with Apache Hive.
• Experience with Git for code commits and version control, and with deploying code through Looper using CI/CD.
• Experience writing shell scripts to automate jobs.
• Experience building real-time data streaming with Apache Kafka.
• Experience retrieving relevant data and running analysis with Data Discovery.
• Experience building data ingestion pipelines with Sqoop.
• Experience designing and testing relational database management systems in BigQuery and MySQL.
• The company will accept any amount of experience with these required skills.

Conditions

Pay is $109,699.00 to $180,000.00 per year, plus annual or quarterly performance incentives.

The role is based at 811 Excellence Dr, Bentonville, AR 72716.

The company is an Equal Opportunity Employer.

The company is committed to a drug-free workplace and has a zero tolerance policy on illegal drugs and alcohol at work, applying to all employees.

Benefits

• Competitive pay, performance-based incentive awards, and health benefits covering medical, vision and dental.
• Financial benefits including a 401(k), stock purchase and company-paid life insurance.
• Paid time off including PTO with sick leave, parental leave, family care leave, bereavement, jury duty and voting.
• Short-term and long-term disability cover, education assistance with 100% company-paid college degrees, company discounts, military service pay, and adoption expense reimbursement.
• Eligibility for some benefits may depend on job classification and length of employment, and benefits and plan terms are subject to change. Details are on the company's site.