Create and manage extensive and complex data sets to fulfill both functional and non-functional business needs. Develop services for integrating a variety of data sources into Everest’s Data Lake, supporting both batch and real-time data. Develop services for data processing (ETL/ ELT) catering to both batch and real-time data engineering requirements. Develop services for orchestrating data processing pipelines. Develop and configure metadata capture and catalog services for pipeline/log data f... more details
Title:
Senior Business Analyst / Warren, NJ (HQ)
Company:
Everest Global Services, Inc.
Job Category:
Underwriting
Job Description:
Join Everest, our forward-thinking insurance company, as we leverage data-driven solutions to transform the industry. We are looking for a talented Data Engineer to enhance our data capabilities and support our growth and modernization strategies. The ideal candidate will be responsible for developing a wide range of data solutions to support our evolving needs in the insurance industry, ensuring alignment with our state-of-the-art data architecture. This vital role involves gathering, refining, and handling extensive and intricate data sets to fulfill our business operations demands.
Key Responsibilities:
Create and manage extensive and complex data sets to fulfill both functional and non-functional business needs.
Develop services for integrating a variety of data sources into Everest’s Data Lake, supporting both batch and real-time data.
Develop services for data processing (ETL/ELT) catering to both batch and real-time data engineering requirements.
Develop services for orchestrating data processing pipelines.
Develop and configure metadata capture and catalog services for pipeline/log data for monitoring/support.
Develop services for data provisioning that suit different data consumption needs, including microservices, APIs, and data extracts.
Provide release support using continuous integration and continuous deployment (CI/CD) pipelines.
Create and maintain operational support documents and standard operating procedures (SOPs) for the maintenance of the data platform/solutions.
Collaborate with the Scrum lead to manage the backlog, sprints, user stories, features, and epics in the development process.
Ensure all data solutions comply with data privacy and security regulations and implement best practices for data encryption and secure data transfer.
Collaborate with cross-functional teams. Work closely with business analysts and other stakeholders to understand data needs and deliver solutions that support data-driven decision-making.
Focus on data quality, aiming for robust and efficient data management. Work closely with various team members to continuously monitor and improve the quality of data in our solutions.
Ensure alignment with cost management principles throughout the design and implementation of data solutions, including aspects of data ingestion, storage and processing.
Mentor and train junior team members. Provide guidance and training to less experienced team members, fostering a culture of learning and continuous improvement.
Technical Competencies:
Sound knowledge and hands-on experience in design and implementation of data engineering pipelines in an Azure cloud environment using: Azure Data Lake Storage Gen2 ADF V2 Databricks Synapse Analytics API Development
Proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and an understanding of data engineering practices.
Extensive experience using Python, PySpark and SQL for data transformation, including: Pandas and Python native data transformation techniques. Building end-to-end data pipelines. Finding efficiency and optimization opportunities in code. Building robust, repeatable tests for delivered solutions. Orchestration.
Familiarity working in both a traditional IDE and Notebook structures e.g., PyCharm, DBeaver
Experience with relational data modelling and querying.
Understanding of how to work with structured, unstructured, and semi-structured data.
Sound knowledge and hands-on experience in managing DevOps environments in Azure with high volume data processing.
Knowledge and experience in designing and implementing event driven solutions using Azure Event Grid, Kafka, Event Hub, IoT Hub, Azure Stream Analytics, etc. are preferred.
Understanding of how to build a dashboard using popular in-memory visualization tools (PowerBI, Tableau, Looker, Qlik, etc.)
Experience working in an Agile environment.
Education and Experience:
Bachelor’s degree in computer science or engineering.
5+ years’ experience in insurance or financial services.
5+ years in the data engineering space with deep experience delivering data & analytics solutions.
Experience working in a large multinational company is preferred.
#LI-RS1
#LI-Hybrid
Our Culture
At Everest, our purpose is to provide the world with protection. We help clients and businesses thrive, fuel global economies, and create sustainable value for our colleagues, shareholders and the communities that we serve. We also pride ourselves on having a unique and inclusive culture which is driven by a unified set of values and behaviors. Click here to learn more about our culture.
Our Values are the guiding principles that inform our decisions, actions and behaviors. They are an expression of our culture and an integral part of how we work: Talent. Thoughtful assumption of risk. Execution. Efficiency. Humility. Leadership. Collaboration. Diversity, Equity and Inclusion.
Our Colleague Behaviors define how we operate and interact with each other no matter our location, level or function: Respect everyone. Pursue better. Lead by example. Own our outcomes. Win together.
All colleagues are held accountable to upholding and supporting our values and behaviors across the company. This includes day to day interactions with fellow colleagues, and the global communities we serve.
Type:
Regular
Time Type:
Full time
Primary Location:
Warren, NJ
Additional Locations:
Everest is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex (including pregnancy), sexual orientation, gender identity or expression, national origin or ancestry, citizenship, genetics, physical or mental disability, age, marital status, civil union status, family or parental status, veteran status, or any other characteristic protected by law. As part of this commitment, Everest will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact Everest Benefits at everestbenefits@everestglobal.com.
Everest U.S. Privacy Notice | Everest (everestglobal.com)
