LinkedIn

Repositories

• ambry

  Distributed object store
  Java Apache-2.0 262 1,474 129 4 Updated Jul 24, 2021

• kafka

  Forked from apache/kafka

  Mirror of Apache Kafka
  Java Apache-2.0 10,305 109 0 14 Updated Jul 24, 2021

• datahub

  A Metadata Platform for the Modern Data Stack

  metadata big-data linkedin data-catalog data-discovery datahub
  Java Apache-2.0 922 3,327 126 13 Updated Jul 24, 2021

• cruise-control

  Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.

  kafka
  Java BSD-2-Clause 396 1,897 62 (11 issues need help) 3 Updated Jul 23, 2021

• TonY

  TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

  machine-learning deep-learning hadoop tensorflow hadoop-yarn
  Java 149 643 31 (2 issues need help) 2 Updated Jul 23, 2021

• spark

  Forked from apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing
  Scala Apache-2.0 24,238 11 0 0 Updated Jul 22, 2021

• gobblin-elr

  This is a read-only mirror of apache/gobblin
  Java Apache-2.0 0 1 0 0 Updated Jul 23, 2021

• datahub-gma

  General Metadata Architecture

  metadata linkedin datahub
  Java Apache-2.0 19 29 9 2 Updated Jul 23, 2021

• avro-util

  Collection of utilities to allow writing java code that operates across a wide range of avro versions.
  Java BSD-2-Clause 31 46 9 5 Updated Jul 22, 2021

• rest.li

  Rest.li is a REST+JSON framework for building robust, scalable service architectures using dynamic discovery and simple asynchronous APIs.
  Java 458 2,142 37 38 Updated Jul 23, 2021

• spark-tfrecord

  Read and write Tensorflow TFRecord data from Apache Spark.
  Scala BSD-2-Clause 31 149 6 (2 issues need help) 0 Updated Jul 22, 2021

• beam

  Forked from apache/beam

  Apache Beam is a unified programming model for Batch and Streaming
  Java Apache-2.0 3,113 0 0 0 Updated Jul 22, 2021

• data-integration-library

  The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.

  data-integration data-ingestion gobblin data-ingest data-egress
  Java BSD-2-Clause 0 8 0 0 Updated Jul 21, 2021

• coral

  Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.
  Java BSD-2-Clause 64 244 7 9 Updated Jul 21, 2021

• iris

  Iris is a highly configurable and flexible service for paging and messaging.

  automation messaging paging escalation
  Python BSD-2-Clause 119 618 28 (1 issue needs help) 4 Updated Jul 21, 2021

• iceberg

  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  Java Apache-2.0 17 33 0 3 Updated Jul 21, 2021

• transport

  A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Apache Hive, and Presto.
  Java BSD-2-Clause 45 162 19 5 Updated Jul 21, 2021

• Burrow

  Kafka Consumer Lag Checking
  Go Apache-2.0 708 2,949 180 (6 issues need help) 11 Updated Jul 21, 2021

• dex-test-parser

  Find all test methods in an Android instrumentation APK

  android testing linkedin android-library test-framework dex
  Kotlin BSD-2-Clause 22 93 0 2 Updated Jul 20, 2021

• css-blocks

  High performance, maintainable stylesheets.

  css sass css-modules
  TypeScript BSD-2-Clause 152 6,298 126 32 Updated Jul 20, 2021

• tracked-queue

  An autotracked implementation of a ring-buffer-backed double-ended queue

  javascript emberjs performance typescript queue ring-buffer glimmerjs
  TypeScript BSD-2-Clause 0 17 0 5 Updated Jul 20, 2021

• brooklin

  An extensible distributed system for reliable nearline data streaming at scale

  java distributed-systems kafka linkedin scalability change-data-capture data-streaming
  Java BSD-2-Clause 97 696 9 12 Updated Jul 19, 2021

• cassette

  An efficient, file-based FIFO Queue for iOS and macOS.
  Objective-C BSD-2-Clause 7 90 5 3 Updated Jul 19, 2021

• icon-magic

  Automated icon build system for iOS, Android and Web
  TypeScript BSD-2-Clause 0 14 13 (4 issues need help) 27 Updated Jul 16, 2021

• spaniel

  LinkedIn's JavaScript viewport tracking library and IntersectionObserver polyfill
  JavaScript Apache-2.0 31 89 10 4 Updated Jul 16, 2021

• school-of-sre

  At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

  mysql python git linux security networking hadoop
  HTML 396 4,667 11 (1 issue needs help) 1 Updated Jul 13, 2021

• lambda-learner

  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  Python BSD-2-Clause 2 5 0 0 Updated Jul 11, 2021

• oncall

  Oncall is a calendar tool designed for scheduling and managing on-call shifts. It can be used as source of dynamic ownership info for paging systems like http://iris.claims.

  calendar scheduling oncall
  Python BSD-2-Clause 165 742 43 (2 issues need help) 4 Updated Jul 9, 2021

• kafka-monitor

  Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived vital statistics - E2E latency, service produce/consume availability, offsets commit availability & latency, message loss rate and more.

  monitor metrics latency topic cluster broker leader
  Java Apache-2.0 408 1,767 2 0 Updated Jul 3, 2021

• linkedin-calcite

  LinkedIn's version of Apache Calcite
  Java Apache-2.0 9 9 1 12 Updated Jul 2, 2021