Lead Software Engineer – Big Data The Williams-Sonoma Architecture and Platform organization is looking for you, an engaged and experienced Lead Software Engineer - Big Data to build analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that opera... more details
Lead Software Engineer – Big Data
The Williams-Sonoma Architecture and Platform organization is looking for you, an engaged and experienced Lead Software Engineer - Big Data to build analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that operationalizes data science models for broad consumption. As a Lead Software Engineer in the Big data Analytics organization, you'll join a small team focused on the delivery of the platform and actionable insights which moves the needle.
KEY JOB FUNCTIONS
- Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice.
- Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production.
- We develop real products. You need to be an expert in design, coding, and scripting.
- Facilitate problem diagnosis and resolution in technical and functional areas.
- Encourage change, especially in support of data engineering best practices and developer satisfaction.
- Write high-quality code that is consistent with our standards, creating new standards as necessary.
- Demonstrate correctness with pragmatic automated tests.
- Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices.
- Develop strong working relationships with others across levels and functions.
- Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest.
- Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain.
- Serve as a member of an agile engineering team and participate in the team's workflow.
- Lead and mentor other engineers.
REQUIREMENTS AND QUALIFICATIONS
- 8 + years of experience as a professional software engineer
- 7+ years of experience with big data technologies including data warehouses
- Prior experience leading a team of 3 or more
- Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time
- Strong knowledge of programming languages/tools including Java, Scala, Python, Spark, SQL, Hive, and Elasticsearch
- Experience with cloud based data warehouses such as Snowflake
- Experience with streaming technologies such as Spark streaming
- Experience with various messaging systems, such as Kafka
- Experience in implementing Lambda Architecture
- Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase
- Working experience with various time-series databases such as OpenTSDB and Apache Druid
- Familiarity with ML and Deep Learning
- Working knowledge of various columnar storage such as Parquet Kudu, and ORC
- An understanding of software development best practices
- Enthusiasm for constant improvement as a Data Engineer
- Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion
- Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood
- Ability to work independently on complex problems of varying complexity and scope
- Bachelor's degree in Computer Science, Engineering or equivalent work experience
We believe in People First
We firmly believe that working in a culture focused on diversity, equity, and inclusion spurs innovation, creates healthy and high-performing teams, and delivers superior customer experiences. Our DEI initiatives prompt associate participation and engagement, aligning with our core vision to reflect the communities where we do business and put people first.
Benefits Just for You
Depending on your position and your location, here are a few highlights of what you might be eligible for:
- A generous discount on all Williams-Sonoma, Inc. brands
- A 401(k) plan and other investment opportunities
- Paid vacations, holidays, and time off to volunteer
- Health benefits, dental and vision insurance, including same-sex domestic partner benefits
- Tax-free commuter benefits
- A wellness program that supports your physical, financial and emotional health
Your Journey in Continued Learning
- In-person and online learning opportunities through WSI University
- Cross-brand and cross-function career opportunities
- Resources for self-development
- Advisor (Mentor) program
- Career development workshops and learning programs
- Speaker series
This role is not eligible for relocation assistance.
Williams-Sonoma, Inc. is an Equal Opportunity Employer. Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances.
The expected starting pay range for this position is $135,000 - $155,000 annually Applicable pay ranges may differ across markets. Actual pay will be determined based on experience and other job-related factors permitted by law. In addition to competitive pay, compensation may include a variety of other components like benefits, paid time off, merit, and bonus opportunities.
