Wang Zheng Yuan

Monday, June 8, 2015

MAKE RASPBERRY PI WEB CONTROLS


OVERVIEW

BASIC OVERVIEW OF WHAT WE WILL BE DOING

This video will show you how make Raspberry Pi web controls to control your Raspberry Pi’s GPIO pins from a web interface. This will allow you to control motors, lights and other electronics from the web! You can even make your own Raspberry Pi Web controlled robot!
More Web Programming Tutorials:
HTML – https://www.youtube.com/watch?v=6Ct6emxVR9w
Javascript – https://www.youtube.com/watch?v=TLjJM-CsOIs
PHP – https://www.youtube.com/watch?v=j-2Rz3nL2HU

Video URL:
https://youtu.be/EAMLwbShFFQ
Posted by panther at 10:40 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

HOW TO MAKE A RASPBERRY PI NAS (NETWORK ATTACHED STORAGE)

http://www.tinkernut.com/portfolio/make-raspberry-pi-nas-network-attached-storage/
Adding a storage device your network is called creating a NAS (Network Attached Storage). And basically it is just a minimalistic computer with a boat load of storage attached to it. So using a Raspberry Pi as our minimalistic computer, let’s create our own Network Attached Storage and make a Raspberry Pi NAS. You can find the project page for this video at the link below. But for now, let’s start tinkering.



STEP 1
GATHER THE PARTS
01_stillview

There really isn’t much you need to do this project, and aside from the Raspberry Pi, you probably already have everything you need.

Raspberry Pi = $35.00
SD Card = $5.00
1 TB External Hard Drive = $60.00
Here are some other parts and tools that you you will probably find around the house (as I did):

Keyboard and Mouse
Ethernet Cable
Monitor
STEP 2
INSTALLING THE SOFTWARE
04_stillview

download raspbian
The first thing you want to do is download the Raspbian image using the link above. This is a stripped down version of Debian linux, so what I’m doing should also work on other Debian based distros, such as Ubuntu.

You then want to burn this one to an SD card using either Win32diskImager on Windows or the dd command for linux or Mac. Then plug the SD card into your Pi with video, mouse, keyboard, internet, power, and your external storage.

STEP 3
SETTING UP THE NAS
05_stillview


Once your pi boots up, you can login using “pi” and “raspberry” and then follow these steps to set it up as a NAS:

Update apt-get and install NTFS-3g
sudo apt-get update
sudo apt-get install ntfs-3g
Find out what path your external drive is located at (ex. /dev/sda1).
sudo apt-get update
Mount the external drive to the media folder and then make a shared folder within it.
sudo mkdir /media/NASDrive
sudo mount -t auto /dev/sda1 /media/NASDrive
sudo mkdir /media/NASDrive/shared
Install the Samba software.
sudo apt-get install samba-common-bin
Edit the Samba config file.
sudo nano /etc/samba/smb.conf
Under the “Authentication” header, remove the hash (#) before
security = user
Under the “Share Definitions” header, change
read only = yes
to

read only = yes
At the bottom of the page add:
[Shared]
comment = Shared Folder
path = /media/NASDrive/shared
valid users = @users
force group = users
create mask = 0660
directory mask = 0771
read only = no
Restart Samba
sudo /etc/init.d/samba restart
Add a new user to linux
sudo useradd [enter new user here] -m -G
Create a new password:
sudo passwd [enter new users name]
Add new user to Samba
sudo smbpasswd -a [enter new users name]
STEP 4
FINAL STEPS
06_stillview


Now on a different computer, if you browse the network you should see your raspberry pi. Trying to access it will prompt you for your username and password, and you can just enter the user and password we just created. Then start storing stuff to it!

If you want to access it from mobile devices you can use apps like Samba for Android or File Explorer for iOS to access network shares.

ALTERNATIVE METHOD
USING OPEN MEDIA VAULT
03_stillview

  download openmediavault
Before we dive into the nerdy method of setting up a NAS on a Raspberry Pi, a super simple alternative is to use Open Media Vault. Open Media Vault is a distribution intended to make it super simple to set up and manage your own NAS.

If you want to give it a try yourself, here are the dead easy steps for setting it up:

Download the most recent OpenMediaVault Raspberry Pi Image (using the button above)
Burn it to an SD card (you can use this guide if you don’t know how)
Plug it into your Raspberry Pi along with a monitor, network cable and power.
When it boots up, the screen will give you your IP Address along with instructions on how to log in.
On a separate computer, open up a browser and type in your Pi’s IP address. On the resulting page, login using the provided credentials (default should be admin and openmediavault).
Use the options provided to set up your networking share and add and manage users!
Posted by panther at 10:28 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

Sunday, June 7, 2015

Benchmarking Differential Gene Expression Tools

In a recent study, Schurch et al., 2015 closely examine 9 differential gene expression (DGE) tools (baySeq , cuffdiff , DESeq , edgeR , limma , NOISeq , PoissonSeq , SAMSeq, DEGSeq) and rate their performance as a function of replicates in an RNA-Seq experiment. The group highlights edgeR and DESeq as the most widely used tools in the field and conclude that they along with limma perform the best in studies with high and low numbers of biological replicates. The study goes further, making the specific recommendation that experiments with greater than 12 replicates should use DESeq, while those with fewer than 12 replicates should use edgeR. As for the number of replicates needed, Schurch et al recommend at least 6 replicates/condition in an RNA-seq experiment, and up to 12 in studies where identifying the majority of differentially expressed genes is critical.
With each technical replicate having only 0.8-2.8M reads, this paper and others (Rapaport et al., 2013) continue to suggest that more replicates in an RNA-seq experiment are preferred over simply increasing the number of sequencing reads. Several other papers, including differential expression profiling recommendations in our Sequencing Coverage Guide recommend at least 10M reads per sample, but do not make recommendations on the numbers of replicates needed. The read/sample number disparity is related to the relatively small and well annotated S. cerevisiae genome in this study and the more complex, multiple transcript isoforms in mammalian tissue. By highlighting studies that carefully examine the number of replicates that should be used, we hope to improve RNA-seq experimental design on Genohub.
So why don’t researchers use an adequate number of replicates? 1) Sequencing cost, 2) Inexperience in differential gene expression analysis. We compare the costs between 6 and 12 replicates in yeast and human RNA-Seq experiments using 1 and 10M reads/sample to show that in many cases adding more replicates in an experiment can be affordable.
Posted by panther at 12:05 PM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

Google Targets Big Genome Data

Google wants to leverage the infrastructure that runs its dominant search engine, Google Maps and Gmail to help analyze and share big genomic data.
Google Genomics is being promoted as a way to store growing DNA data in the cloud. Users could load and export genomic data for free, then pay about $25 a year for storage and queries. Storage is calculated in terabytes per month, queries in millions of API calls.
The search giant joins other cloud giants in the growing competition to store the skyrocketing amount of data as more genomes are being shared, compared and linked. The results of those comparisons are expected to drive the emerging big genomic data sector. Google Genomics claims to allow comparisons “in seconds with SQL-like queries.”
Ultimately, Google says it is trying to converge data science and the life sciences to spur medical research.
The field is considered ripe for innovation. As Google points out, about 99.9 percent of human DNA is identical, but “in practice, the files start out much bigger because you need to do a lot of analysis to identify that zero point one percent that makes each of us unique.”
Since the human genome was first sequenced, the time and cost involved in gene sequencing has plummeted, according to Google, to about one day and $1,000. “With an exponential price drop like that, the volume of sequencing has exploded,” Google Genomics’ product manager Jonathan Bingham noted.
As the cost of DNA sequencing has dropped, data volumes have soared into the petabytes. Bingham estimates the size of each genome represents about 100 gigabytes of data. It is the mixing and matching of genomic data that is driving the need for storage that is linked to data analytics tools, cloud storage proponents insist.
Google’s pitch focuses on the capabilities of its current infrastructure that includes a search index of 100 petabytes and search query returns in about 0.25 seconds. The cloud provider is promising similar results for genetics researchers “without owning a datacenter,” Bingham asserted.
Google Genomics said during its I/O event in June it was working with the genomics community to define a standard API for working with big genomic data sets in the cloud. More recently, it announced it was implementing an API defined by the Global Alliance for Genomics and Health that covers data visualization and analysis.
“We are hosting public data that is available through the API and we’re building open-source software showing how to work with big genomic data using that API,” explained Bingham. Google also said its approach allows for analysis of genomic data via either interactive queries or through massively parallel processing.
Meanwhile, the Google unit said it is also offering data analytics tools like AppEngine, BigQuery, MapReduce and R on the Google Cloud Platform to sift through and share genomic data,
said Bingham, who also heads Google’s efforts to merge cloud computing with life sciences.
The timing of Google Genomic appears propitious: The Global Alliance for Genomics and Health convened last month in San Diego to consider ways to “accelerate sharing of genomic and clinical data.”
Recent items:
Google Re-Imagines MapReduce, Launches DataFlow
Machine Learning Gets a Boost From Google
Posted by panther at 11:37 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

Building an IT Foundation for Big Data Success

We are in the midst of a major transformation in the business landscape, one that’s being driven by disruptive technologies such as cloud and mobile computing, social media, and big data analytics, says Jacqueline Woods, global vice president for Growth Solutions.
There are tremendous opportunities to grow, but also increasing pressures to compete. Most companies are not prepared to face the challenges and meet today’s opportunities, Woods said during a keynote at Datanami‘s recent Leverage Big Data event.
“If you think about what’s going on in the digital marketplace, there are new economies that are emerging, sharing economies like Airbnb and Lyft and new forms of banking like Apple Pay,” Woods said during her presentation.
“These new business are forcing traditional firms to rethink how they compete. So how has competition changed? And how will companies need to optimize their IT infrastructure capabilities in order to be competitive? We think that it’s going to play a pivotal role in your posture as firm in order to be more competitive.”
The companies that are best situated to compete in the emerging data-driven economy are those that are “strategic IT connectors,” Woods says. To find out if you work at a strategic IT connector, check out a video of Woods’ keynote below.
Related Items:
Watch DDN’s Molly Rector’s Leverage Big Data 2015 Keynote
Leverage Big Data 2015 Yields Insightful Gems
One on One with IBM’s Global VP for Data Analytics
Posted by panther at 11:35 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

Saving Children’s Lives with Big Genomics Data

It’s estimated than one in 30 children is afflicted by one of 8,000 or so genetic diseases that we have discovered. Thanks to progress in the world of genomic testing—including faster genomic sequencers and better algorithms for making more accurate diagnoses—doctors are making progress in identifying genetic diseases and getting children the treatment they need.
While the medical community has been studying genetic diseases for decades, its ability to correctly diagnose genetic diseases and prescribe a suitable course of treatment has been limited. That puts stress not only on the patient, but on the patients’ families too.
One group that’s pushing the envelope in genomics is Children’s Mercy Hospital of Kansas City. Shane Corder, a senior HPC system engineer at Children’s Mercy, shared his experiences with pediatric genomics during a keynote address at the recent Leverage Big Data conference in Florida.
“We know the causes of less than 5,000 of these genetic diseases,” Corder says in the keynote, which you can view on YouTube. “Diagnoses often take years. That’s unacceptable for families and ultimately it should be unacceptable to society as a whole.”
Childrens Mercy
Stephen Kingsmore, executive director of Medical Panomics at Children’s Mercy Hospital of Kansas City, uses an Illumina sequencer.
Children’s Mercy is a leader in the adoption of genomics in a clinical setting, and has treated thousands of children and babies over the past few years. It has two primary types of patients, include newborns who display characteristics of a genetic disease—where time is critical–and children who have been unable to get an accurate diagnose elsewhere.
The hospital brings two main genomics tests to bear on these patients, including full-genome tests and partial genome tests. Genetic sequencing is a very data- and compute-intensive business. With more than 6.4 billion letters in a person’s DNA–which involves 22,000 genes that code for 100,000 proteins–there’s a lot of data to analyze.
It took 10 years and $3 billion to completely map the first human genome, which you will remember as the Human Genome Project. But thanks to technological advances over the years—including next-gen sequencers from Illumina and the Dragen Bio-IT processor from Edico Genome—geneticists, doctors, and technologists have whittled down the amount of time it takes to sequence a given person’s genome, which comes out to about 250GB per person.
“There are some fairly exciting new technological advances that we’re hoping to implement here in the center that will eventually let us go sub-24 hours on a full genome,” Corder says. “Currently our fastest sequence technology is pushing 50 hours for a full genome, from sample-taking to diagnoses.”
When Corder joined the team, the hospital was able to diagnose and begin treatment (using standard medical approaches mostly—gene therapy is something else entirely) of genetic diseases on about 47 percent of its patients. Now it’s up to 52 percent of its patients.
“Genomic sequencing is wonderful, but it’s not infallible,” he says. “When a child is waiting for a diagnoses, a lot of times the disease lays waste to their body or their mind. With quicker diagnoses and treatment, that can ultimately change the child’s life forever.”
Related Items:
Peek Inside a Hybrid Cloud for Big Genomics Data
Build or Buy? That’s the Big (Data) Question
Building an IT Foundation for Big Data Success
Posted by panther at 11:34 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest

Five Ways Big Genomic Data Is Making Us Healthier

genetic_disease
We’ve come a long ways since the human genome was first decoded 13 years ago. Thanks to continued advances in high performance computing and distributed data analytics, doctors and computer scientists are finding innovative new ways to use genetic data to improve our health.
The economics of genetic testing is creating a flood of genomic data. The Human Genome Project took over a decade and cost $3 billion, but today whole-genome tests from Illumina can now be had in a matter of weeks and $1,000. While storing these test results (a whole genome is about 250 GB) is a big data exercise in itself, it’s what you do with that data that counts. Here are five ways genetic data is being put to use:
  1. Genetic Counseling? There’s an API for That

We all know that DNA plays a big role in whom we become. But in the real world, it’s the interplay between our genetics and our environment that truly defines us. Accurately breaking these two components down and differentiating “nature versus nurture” is not easy, but that’s essentially what a genetic health software company called Basehealth is trying to do, at least for a few dozen diseases.
Basehealth helps people figure out how lifestyle and medical factors interact with genes.
Basehealth helps people figure out how lifestyle and medical factors interact with genes.
Basehealth came out of stealth a year ago with a software platform called Genophen that’s designed to do the hard work of deciphering all of the various risk factors that come into play for certain diseases, such as type 2 diabetes, heart disease, depression, and various forms of cancer. Mixing one’s genetic data with real-world data describing other factors–such as the patient’s diet, exercise, weight, and lifestyle–provides a better description of someone’s risk for contracting a given disease (and creating solid plans for avoiding them) than genomic data all by itself.
When Basehealth launched its MongoDB– and R-based application a year ago, it figured individual healthcare practices would use it as a standalone health portal to provide patients with counseling and “what-if” style analysis similar to online retirement calculators. But since then, the Redwood City, California company realized that enabling simpler access to its software is a better approach, so yesterday it announced that Genophen is accessible over the Web via API.
“A lot of folks in the market already had system of their own,” says Basehealth CTO Prakash Menon. “They work with EHRs [electronic health records] and patient portals. People kept coming back to us and saying, ‘This is all really good, but we’d like to integrate this stuff that you’ve done into our own platforms.'”
The new REST API that Basehealth is exposing lets subscribers take advantage of the research into medical literature that Basehealth has done. Using natural language processing (NLP) algorithms, the company has essentially quantified risk factors for 40-some diseases and conditions. Those factors are used to create models that allow doctors to predict health outcomes based on a person’s combination of genes and environmental factors.
The APIs will enable Genophen to plug into the emerging virtual world of medical data services. “Physicians are building their own portals that bring all of the data they have for their patients,” Menon tells Datanami. “A lot of people have genetic information on 23andMe or Ancestry.com for instance, and they want to bring that data. They get information from their own EHRs, from patient devices like Fitbits, and put together a profile. Then they call us for an assessment and they use the assessment to drive their engagements with their patients.”
  1. Craig Venter’s Giant Gene Database

While the National Institute of Health was spending billions of dollars on the Human Genome Project, former NIH biologist J. Craig Venter launched his own parallel effort at Celera Genomics, taking a different approach and spending just hundreds of millions. Eventually, the two camps combined efforts, and shared in the glory (which was even more special for Venter, who provided the DNA that was first decoded).
Now Venter is trying to take genomics to the next level with his latest venture, Human Longevity Inc. The San Diego, California-based company has already bought two of Illumina‘s next-gen genetic sequencing systems, the HiSeq X Ten, and could buy several more in its bid to sequence 100,000 genomes per year.
J Craig Venter
Craig Venter describes Human Longevity Inc. as a “data analysis group.”
Along with the genotype data from the Illumina sequencers, HLI also will be collecting phenotype data, or information about how the genes are expressed in human physiology and bio-chemistry.
Armed with these data sets, HLI aims to create the largest human gene-phenotype database in the world. It plans to use this data to identify relevant patterns that could be used to create novel drugs and therapies that extend human life and slow the process of biological decline.
While HLI will be taking and processing DNA samples, Venter considers HLI at heart to be a “data analysis group,” he said in a November story in The Huffington Post. The size of its HLI Knowledgebase may be huge, but software algorithms can help make the data manageable, much like a picture can be compressed, he said.
HLI will be employing the latest machine learning and artificial intelligence techniques to tease knowledge from the huge gene-phenotype database. “Teams are developing and applying novel statistical genetic, bioinformatics, and data mining algorithms to identify these patterns,” the company says on its website. “These will be implemented on novel computing architectures in partnership with leading computing vendors and centers such as the San Diego Supercomputer Center.”
  1. A Pipeline for Diagnosing Undiagnosed Diseases

Approximately 25 to 30 million Americans suffer from rare diseases, which are defined as those that effect 200,000 people or fewer. Not all of them have a genetic component, but a good number of them are believed to be hereditary. The NIH is seeking to find cures for some of these by studying genomics through its Undiagnosed Diseases Program (UDP).
Assisting the UDP with its goal is Appistry, a St. Louis, Missouri company that develops high-performance big data solutions. The company helped the program launch a genetic analysis pipeline that allows the UDP to compare genomes within a family to identify changes that may be causing disease. By using a form of genetic triangulation, the UDP Integrated Collaboration System (UDPICS) is able to dischromosomescern where genetic variations from a parent to a child may be causing disease.
“For an individual with an unknown disease, we need to identify which genetic change is the cause,” says William A. Gahl, the doctor who ran the UDP program at the NIH before recently joining Appistry. “Current methods compare an individual’s genome to a generic reference genome, which may differ significantly from the individual’s. That creates an unnecessarily large number of possible genetic changes to pursue. Determining which changes are relevant is time-consuming and computationally intensive.”
So far, the pipeline has helped the UDP processed genetic data from about 250 patients. What’s more, in late April, the program was awarded a Best Practices Award from Bio-IT World. According to Applicatory, Bio-IT World’s editorial director Allison Proffitt called the system “orders of magnitude more valuable than Craig Venter’s genome.”
  1. Parallel Genomic Sequencing on Hadoop

With its HiSeq X Ten sequencers, San Diego-based Illumina seems to have a lock on the mechanical devices used to decode human genes, at least for now. But when it comes to the software used to analyze the data that comes out of those machines, there’s been a flurry activity and progress from many institutions.Hadoop logo
As it turns out, Apache Hadoop is playing in the genetic analysis game too. The University of North Carolina (UNC) at Chapel Hill is running a 50-node Hadoop cluster to process the genetic data coming out of their Illumina machines. According to this story on the Intel website, the parallelism of Hadoop matches perfectly to the deep analysis of genetic data that UNC demands for both research and clinical healthcare settings.
“The Hadoop system allows us to perform very custom analysis that you wouldn’t find in a traditional business intelligence tool or that would work in a SQL relational type of structure,” writes Charles Schmitt, director of informatics and data Sciences at UNC’s Renaissance Computing Institute (RENCI). “Our analyses amend well to a MapReduce structure. The other issue is that tests with databases that use extract, transform, load (ETL) take an incredibly long time with that much data. With Hadoop there’s no ETL; we just add a file into the system.”
The group is analyzing about 30 genomes a week, according to Schmitt, and has between 200 and 300 TB of genomic data stored in an EMC Isilon object storage system. Along with Hadoop are several other critical components of the workflow, including Enterprise iRODS grid software for managing the data, and the Secure Medical Workspace system for securing patient data.
  1. Saving Kids from Genetic Disease

It’s estimated that one in 30 people have a genetic disease of some sort. Hopefully, it’s just a mild form of asthma that’s merely an inconvenience for the carrier, but unfortunately, there are a lot more nasty genetic diseases circulating in human DNA.
Considering that we have identified the genes responsible for only about 5,000 out of the 8,000 known genetic diseases, there’s a lot of work left to be done. One medical practice that’s on the frontline of this work is the Children’s Mercy Hospital of Kansas City.
Shane Corder, a senior HPC system engineer at Children’s Mercy, shared his experiences with pediatric genomics during a keynote address at the Leverage Big Data conference in Florida this March. According to Corder, the hospital is gearing up to take advantage of the fast Illumina sequencers to help newborns who are suffering from genetic diseases.
Vast amoungs of genetic data is being analyzed thanks to Illumina's fast new genetic sequencers.
Vast amoungs of genetic data is being analyzed thanks to Illumina’s fast new genetic sequencers.
“There are some fairly exciting new technological advances that we’re hoping to implement here in the center that will eventually let us go sub-24 hours on a full genome,” Corder said. Currently, the hospital’s fastest sequence technology takes about 50 hours to get a diagnosis.
“When a child is waiting for a diagnosis, a lot of times the disease lays waste to their body or their mind,” Corder said. “With quicker diagnoses and treatment, that can ultimately change the child’s life forever.”
Related Items:
Saving Children’s Lives with Big Genomics Data
Peek Inside a Hybrid Cloud for Big Genomics Data
Google Targets Big Genome Data
Posted by panther at 11:32 AM No comments:
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest
Newer Posts Older Posts Home
Subscribe to: Posts (Atom)

Blog Archive

  • ▼  2018 (5)
    • ▼  April (1)
      • Basic Primer: Blockchain Consensus Protocol
    • ►  March (2)
    • ►  February (1)
    • ►  January (1)
  • ►  2017 (2)
    • ►  September (1)
    • ►  May (1)
  • ►  2016 (71)
    • ►  October (4)
    • ►  September (1)
    • ►  July (2)
    • ►  May (10)
    • ►  April (4)
    • ►  March (14)
    • ►  February (22)
    • ►  January (14)
  • ►  2015 (189)
    • ►  December (12)
    • ►  November (23)
    • ►  October (10)
    • ►  September (6)
    • ►  August (10)
    • ►  July (48)
    • ►  June (33)
    • ►  May (5)
    • ►  April (6)
    • ►  March (23)
    • ►  February (9)
    • ►  January (4)
  • ►  2014 (113)
    • ►  December (10)
    • ►  November (17)
    • ►  October (8)
    • ►  September (6)
    • ►  August (20)
    • ►  July (1)
    • ►  June (2)
    • ►  May (1)
    • ►  April (2)
    • ►  March (16)
    • ►  February (15)
    • ►  January (15)
  • ►  2013 (75)
    • ►  December (15)
    • ►  November (6)
    • ►  October (2)
    • ►  September (8)
    • ►  August (7)
    • ►  July (19)
    • ►  June (9)
    • ►  May (5)
    • ►  April (2)
    • ►  January (2)
  • ►  2012 (103)
    • ►  December (22)
    • ►  November (13)
    • ►  October (8)
    • ►  August (20)
    • ►  July (18)
    • ►  June (18)
    • ►  May (3)
    • ►  April (1)

About Me

panther
View my complete profile
Picture Window theme. Powered by Blogger.