Big Data Platform Engineer at Curate Partners in Boston
Looking for an experienced Big Data Platform Engineer to maintain and manage Platform applications on the Analytics Platform, including both On-premise and Cloud infrastructure.
o Manage Hadoop applications in both On-premise and Cloud environments.
o Install and configure tools and services on AWS Cloud Platform (S3, IAM, KMS, Athena, Kafka, Tableau, Snowflake etc.)
o Work with Platform Leads and Architects to implement routine check-up, back-up and monitoring of the Platform.
o Planning for capacity upgrading, downsizing as and when the need arises (Physical/Virtual Servers).
o User management and administration.
o Installing and configuring monitoring tools that are critical for the operational availability of the Platform.
o Providing day-to-day support for projects/teams using the Big Data Platform (Developers, Testers, Analysts, Data Scientists).
o Analyzing and debugging slow-running development, performance, and production jobs.
o Coordinating Root Cause Analysis (RCA) efforts to help minimize future system issues.
o Creating and publishing production metrics which include system performance and reliability information to system owners and management teams.
o Partnering with the Infrastructure and other teams within BCBS in the administering of server hardware and operating systems.