DESCRIPTION
Cutting edge big data technology with Spark, EMR, Glue, SageMaker, and Airflow? Check. Deep involvement with business strategy decisions? Check. Work across one of the world's largest and most complex data environments? Check.
Are you excited about the idea to work with big data resources and technologies? Are you up to the challenge of working with top PhD economics and data science researchers to bring front tier economic theories to production? Are you ready to build data pipelines and integrate AWS services that inform billion dollar business decisions across Amazon? If your answer is yes, come join us!
We are a hybrid research + engineering team that brings disruptive econometric models to life in the media entertainment and advertising domains. As an experienced Software Engineer, you will collaborate with economists, data scientists, and developers across the company to develop, test and deploy services that implement a wide range of econometric models. This requires the use of sophisticated distributed systems, application of advanced statistical techniques and the processing of big data. A successful candidate will have a passion for innovation, interest in cutting-edge technology, and excitement about working with data in a high-impact business domain.
This is an opportunity to create and build software for advanced data analytics to support and enable data-driven decision making inside Amazons fast growing digital media businesses.
Key job responsibilities
As a Data Engineer, you will/may:
Design, implement, and automate deployment of our distributed system for collecting and processing log events from multiple sources
Design data schema and operate internal data warehouses and SQL/NoSQL database systems
Own the design, development, and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions
Monitor and troubleshoot operational or data issues in the data pipelines
Drive architectural plans and implementation for future data storage, reporting, and analytic solutions
Work collaboratively with Business Analysts, Data Scientists, and other internal partners to identify opportunities/problems
Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of a problem
A day in the life
You'll spend most the day coding, possibly writing or testing Spark jobs, updating our reusable python libraries, or tweaking an Apache Airflow graph.
You'll join a daily standup and sync with your team mates, and maybe perform a code review or two. Depending on the project phase you may be finishing up your design document for review with your fellow engineers or scientists.
Finally you'll probably join a couple of meetings, either related to your project, Sprint Planning, or maybe even a fun team event!
About the team
We're a pretty atypical team at Amazon, with engineers outnumbered by scientists 3 to 1.
Our mission is to
1) productionize science prototypes into well tuned, scaled systems
and
2) support and improve data infrastructure for scientists to quickly prototype new ideas and models.
You'll be working closely on your projects not just with other data or software engineers, but with Business Intelligence Engineers, Economists, and Data Scientists.
Your engineering background and experience is critical to building reliable, cost effective products for our business partners and Amazon customers.
We are open to hiring candidates to work out of one of the following locations:
Culver City, CA, USA
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
