Github amplab

AMPLab at UC Berkeley · GitHub » GitHub is where people build software. More than 28 million people use GitHub to discover, fork, and contribute to over 78 million projects. Github.com

Splash - Efficient Stochastic Learning on Clusters » What is a Stochastic Learning Algorithm? Stochastic learning algorithms are a broad family of algorithms that process a large dataset by sequential processing of random samples of the dataset. Since their per-iteration computation cost is independent of the overall size of the dataset, stochastic algorithms can be very... Zhangyuc.github.io

GitHub - amplab/succinct: Enabling queries on compressed data. » Enabling queries on compressed data. Contribute to succinct development by creating an account on GitHub. Github.com

Spark In MapReduce (SIMR) by databricks » What is SIMR? SIMR provides a quick way for Hadoop MapReduce 1 users to use Apache Spark. It enables running Spark jobs, as well as the Spark shell, on Hadoop MapReduce clusters without having to install Spark or Scala, or have administrative rights. Note that this is for Hadoop MapReduce 1, Hadoop YARN users... Databricks.github.io

GitHub - amplab/docker-scripts: Dockerfiles and scripts for Spark ... » README.md. Dockerfiles for Spark and Shark. Contents. Dockerfiles to build Spark and Shark images for testing and development. Requirements. Tested on Ubuntu 12.04 (Docker version 0.6.4), Ubuntu 13.10 (Docker 0.7.0 and 0.9.0) with the virtual switch lxcbr0 enabled. For running Docker on Mac and Windows see the... Github.com

GraphX by amplab » Connect to the Spark cluster val sc = new SparkContext("spark://master.amplab. org", "research") // Load my user data and prase into tuples of user id and attribute list val users = sc.textFile("hdfs://user_attributes.tsv") .map(line => line. split).map( parts => (parts.head, parts.tail) ) // Parse the edge data which is already in... Amplab.github.io

KeystoneML » KeystoneML is a software framework, written in Scala, from the UC Berkeley AMPLab designed to simplify the construction of large scale, end-to-end, machine learning pipelines with Apache Spark. ....Have a look at our Github Issues page if you'd like to contribute, and feel free to fork the repo and submit a pull request! Keystone-ml.org

SparkR by amplab-extras » Project maintained by amplab-extras Hosted on GitHub Pages — Theme by mattgraham ...DataFrame: DataFrame was introduced in Spark 1.3; the 1.3- compatible SparkR version can be found in the Github repo sparkr-sql branch, which includes a preliminary R API to work with DataFrames. To link SparkR against older... Amplab-extras.github.io

AMPLab – UC Berkeley | Algorithms, Machines and People Lab » [AMPLab Seminar] Martin Körling, Ericsson, “cloud infrastructure for high-data- volume and low-latency applications”, Th 11/3, Noon, The Woz · [Seminar] Alvin Cheung, U Washington, Towards Self-Generating Data Management Systems, Th 11/10, noon, 373 Soda · AMPLab End Of Project Celebration (Th&F 11/17,18) ... Amplab.cs.berkeley.edu

GitHub - amplab/spark-ec2: Scripts used to setup a Spark cluster on ... » Scripts used to setup a Spark cluster on EC2. Contribute to spark-ec2 development by creating an account on GitHub. Github.com