All roles

Open role

Principal Engineer (Big Data Engineer)

Remote · Malaysia Full-time

About the job

Accelerate your career with PradeepIT

PradeepIT is one of the largest, globally recognized IT Consulting firm to connect India's deeply vetted talent team to global customer.

Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500 companies and fast-growing startups.

With continuous hard work and working remotely by choice, PradeepIT is certified as a Great Place to Work! Trusted by leading brands and fortune 500 companies from around the world, we have achieved:

6+ Years of Experience

580+ Open source technology Consultant

120+ SAP Consultant

40+ Salesforce Consultant

60+ Adobe Consultant

100+ Mobility Consultant

890+ Clients in APAC, EMEA & USA

Our Beliefs

PradeepIT believes in connecting people across the globe and provide them an opportunity work on remotely. Being a people-first organization, PradeepIT constantly strives for individuals who won't just keep up, but break new ground, work with cutting edge technology and ramp-up their skills with course created by our Vertical Heads, Senior Architect for freely with help of PradeepIT Academy.

Principal Engineer (Big Data Engineer)

Experience: 12 15 years



Requirements

  • Should have a strong technical background with Big data, Spark, Python (PySpark) / Scala/Java, AWS/Azure/GCP;
  • Experience working with MS SQL and NoSQL databases (Hbase, Cassandra).
  • Abilities to build Data Pipelines (from ETL to consumption) using Apache Stack Tools, GCP, AWS and Azure.
  • Design and develop complex mappings, performance tuning of mappings, Process Flows
  • Hands-on experience in System designing, Event sourcing, and message broker architecture
  • Requirement gathering and analysis
  • Define, understand, and analyze non-functional requirements for the project
  • Lead the technical team
  • Should be able to compare technologies to find the best fit for project requirements
  • Should be able to troubleshoot complex or unusual bugs

Responsibilities:

  • Writing and reviewing great quality code/support
  • Understanding the client's business use cases and technical requirements and being able to convert them into a technical design that elegantly meets the requirements.
  • Mapping decisions with requirements and being able to translate the same to developers.
  • Identifying different solutions and being able to narrow down the best option that meets the client's requirements.
  • Defining guidelines and benchmarks for NFR considerations during project implementation
  • Writing and reviewing design documents explaining the overall architecture, framework, and high-level design of the application for the developers
  • Review architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
  • Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
  • Understanding and relating technology integration scenarios and applying these learnings in projects
  • Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.



Originally posted on

More open positions

Scripting Developer

Work from home Full-time role

BRIM Bill Management - Architect

Work from home Full-time role

Full stack developer

Work from home Full-time role

SAP Workflow Developer

Work from home Full-time role

Senior Product Manager - AI & Healthcare Innovation

Work from home Full-time role

Senior Data Engineer (Remote)

Work from home Full-time role

Home Infusion Registered Nurse (RN) - PRN

Work from home Full-time role

Remote Customer Service Specialist – 100% Work From Home, Commission-Based Salary, Life & Health Insurance Licensing & Training – Join careerpulse Today

Work from home Full-time role

Bookkeeper (Part Time)

Work from home Full-time role

Channel Development Lead

Work from home Full-time role

Senior Remote Customer Service Representative – Global Support & Subscription Sales – Join workpinnacle’s Innovative Remote Team

Work from home Full-time role

Manager, Partnership Marketing

Work from home Full-time role

[Remote] External Wholesaler - Retirement Job Details | Lincoln Financial

Work from home Full-time role

Network Contracting & Services Associate

Work from home Full-time role

Independent Sales Representative (Yearbooks)

Work from home Full-time role

Director Program Management || Must be FL Resident Only || This position is remote with some on-site work required

Work from home Full-time role

Dynamic Remote Research Participant Coordinator – Flexible Part‑Time, High‑Earning Opportunities in Market & Consumer Insights with hirevault

Work from home Full-time role

Senior Remote Customer Support Specialist – Championing Exceptional Client Experience & Advanced Technical Troubleshooting for brighthush’s Innovative SaaS Solutions

Work from home Full-time role

Infusion Clinic Scheduler - Remote

Work from home Full-time role

Lead Process Analyst

Work from home Full-time role

Email Marketing Manager- REMOTE POSITION

Work from home Full-time role