Big Data Platform Engineer at Curate Partners in Boston

Looking for an experienced Big Data Platform Engineer to maintain and manage Platform applications on the Analytics Platform, including both On-premise and Cloud infrastructure.

o   Manage Hadoop applications in both On-premise and Cloud environments.

o   Install and configure tools and services on AWS Cloud Platform (S3, IAM, KMS, Athena, Kafka, Tableau, Snowflake etc.)

o   Work with Platform Leads and Architects to implement routine check-up, back-up and monitoring of the Platform.

o   Planning for capacity upgrading, downsizing as and when the need arises (Physical/Virtual Servers).

o   User management and administration.

o   Installing and configuring monitoring tools that are critical for the operational availability of the Platform.

o   Providing day-to-day support for projects/teams using the Big Data Platform (Developers, Testers, Analysts, Data Scientists).

o   Analyzing and debugging slow-running development, performance, and production jobs.

o   Coordinating Root Cause Analysis (RCA) efforts to help minimize future system issues.

o   Creating and publishing production metrics which include system performance and reliability information to system owners and management teams.

o   Partnering with the Infrastructure and other teams within BCBS in the administering of server hardware and operating systems.