Sr. Staff Data Architect

REQ: REQ-111870 Engineering

  • Lake Forest, CA, United States
Apply Apply

The Senior Staff Data Architect position is responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems. The Data Architect will support software developers, database architects, data scientists on data initiatives and will ensure optimal data delivery architecture. The Data Management Architect will define and lead the big data and information architecture needs for the company. The data management architect will partner with the data science leader to deliver data driven solutions that enable operational efficiency, operational excellence and improve product experience by customers.
 
MAJOR RESPONSIBILITIES
Data Design Management

  • Design and deliver a portfolio of product data sets from the definition phase through to production deployment. 
  • Design and architect for distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time. 
  • Architect solutions for the design and implementation of EMR Cluster and Big Data Infrastructure. 
  • Create data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts and etc. 
  • Perform offline analysis of large data sets using components of a big data software ecosystem. 
  • Evaluate big data technologies and prototype solutions to improve data processing architecture. 
  • Lead efforts to determine root cause of complex data provenance, metadata issues and engineering questions that may involve interfacing with various technical staff in multiple organizations and with differing levels of expertise.
  • Own product features from the development phase through to production deployment.
  • Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
  • Provide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.
  • Deploy and maintain Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.
  • Create data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc
  • Perform offline analysis of large data sets using components of a big data software ecosystem.
  • Evaluate big data technologies and prototype solutions to improve data processing architecture.
  • Monitor installation of HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.
  • Troubleshoot and determine root cause of complex data provenance, metadata issues and engineering questions that may involve interfacing with various technical staff in multiple organizations and with differing levels of expertise.
  • Investigate, evaluate, test and recommend technical solutions for future systems.
  • Develop tools and procedures to monitor and automate system tasks on servers and clusters

 
Technical Advisor

  • Collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases. Evaluate and advise on technical aspects of open work requests in the product backlog with the project lead

 
KNOWLEDGE/SKILL REQUIREMENTS

  • Knowledge of database concepts, object and data modeling techniques and design principles
  • Detailed knowledge of database architectures, software, and facilities
  • Successful history of manipulating, processing, and extracting value from large disconnected data sets
  • Experience with programming languages – Python (required), Scala, Ruby, R
  • Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL
  • Experience with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR
  • Experience with stream-processing systems: Kinesis, Kafika, MQTT
  • Experience with relational NoSQL databases including DyanamoDB
  • Code/Build/Deployment - git, jenkins, aws code*
  • Good verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.
  • Works on complex issues where analysis of situations or data requires an in-depth evaluation of variable factors. Exercises judgment in selecting methods, techniques and evaluation criteria for obtaining results.
  • Specialist on complex technical and business matters. 
  • Will champion significant projects, programs and business initiatives using demonstrated creativity and ingenuity. 

 
EDUCATION/EXPERIENCE REQUIREMENTS

  • Bachelor’s degree in computer science, computer engineering, or a related field, or the equivalent combination of education and related experience.
  • 8 years of professional experience as a data  software engineer
  • 2 years of experience with AWS cloud computing design, provisioning, and tuning.
  • Related AWS certification, preferred
  • Previous experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.

Panasonic is proud to be an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, disability status, protected veteran status, and any other characteristic protected by law or company policy.  All qualified individuals are required to perform the essential functions of the job with or without reasonable accommodation. Pre-employment drug testing is required for safety sensitive positions or as may otherwise be required by contract or law. Due to the high volume of responses, we will only be able to respond to candidates of interest. All candidates must have valid authorization to work in the U.S. Thank you for your interest in Panasonic Corporation of North America.
#LI-SR2 

REQ: REQ-111870 Engineering

  • Lake Forest, CA, United States
Apply Apply

As a global policy, Panasonic does not recognize resumes or other application materials submitted from staffing agencies and search firms outside of our system. Therefore, please do not submit resumes or other application materials through the external Panasonic web site or directly to our employees. Any resumes or other application materials submitted through the external web site or directly to employees of Panasonic or any of its subsidiaries or affiliates will not be eligible for any agency fee, and the resume and other application materials will be added to our database for direct recruitment.

Panasonic assigns only certain positions to approved staffing agencies and search firms that have a current agreement with Panasonic in place. Not all positions are eligible for an agency fee.