As I'm learning BigData technologies and then I found Big Data is a big tool for Machine Learning , now to justify that I must know what is Machine Learning and Technologies.
So here I researched through internet and made my notes , its a kind of Technical notes but not very tough to understand and seriously its Funnnnnnnnn !!!!!!!!!!!!! :-)
Machine Learning is heavily used in analyzing and
understanding system. Like google search or Facebook photo tagging all are
machine learning.
Database mining
is one of the very big examples of Machine Learning.
Example – Web click, Biological
Other set of examples are like non-human programmed application where human interaction is
minimal. Like Auto Pilot system where there is no human interaction but things
are driving, that’s where learning comes.
Example – handwriting recognition, NLP, computer Vision,
Facial Recognition
Self-Automated
System – like Amazon and all which understands your need based on your
pick.
What is Machine Learning
Chess program was the main example for the above definition.
So a computer Program said to be learning if it get improvises or learning getting increasing as the time passes.
So a Task T from below is considered as Task like if a user make an email Spam by clicking on Spam button , so task is classifying an email is a Spam or not
Unsupervised
Learning – Where a system understands by itself.
Supervised Learning Algorithm
Supervised Learning returns “Right Answer” based on
your input, precisely how many proper right answers it returns matters.
If above example shows graph X – axis = property Square feet
&& Y-Axis – Dollar in 1000
Then a customer has a land of 750 Square feet and he needs to know the price he must expect.
So the Straight red line is one kind of supervised algorithm which says the price come as 100*1000 USD but the same which curved line ie polynomial algorithm shows the value can be expected as 200. So this shows which supervised algorithm to choose and what is the expected value, so this is an example of machine learning.
The example as well shows one important point i.e. Regression Problem means predict continuous valued output.
Examples of Supervised Learning ;
Supervised algorithm has few types; one of them is as follows-
Then a customer has a land of 750 Square feet and he needs to know the price he must expect.
So the Straight red line is one kind of supervised algorithm which says the price come as 100*1000 USD but the same which curved line ie polynomial algorithm shows the value can be expected as 200. So this shows which supervised algorithm to choose and what is the expected value, so this is an example of machine learning.
The example as well shows one important point i.e. Regression Problem means predict continuous valued output.
Examples of Supervised Learning ;
Given a large dataset of medical records from patients suffering from heart disease, try to learn whether there might be different clusters of such patients for which we might tailor separate treatments.
(his can be addressed using an unsupervised learning, clustering, algorithm, in which we group patients into different clusters.)
Have a computer examine an audio clip of a piece of music, and classify whether or not there are vocals (i.e., a human voice singing) in that audio clip, or if it is a clip of only musical instruments (and no vocals).
(This can be addressed using supervised learning, in which we learn from a training set of audio clips which have been labeled as either having vocals or not)
Given genetic (DNA) data from a person, predict the odds of him/her developing diabetes over the next 10 years
(This can be addressed as a supervised learning, classification, problem, where we can learn from a labeled dataset comprising different people's genetic data, and labels telling us if they had developed diabetes.)
Supervised algorithm has few types; one of them is as follows-
From the above diagram, blue cross are Tumor Size and Red
or malignant which is not healthy means a cancer risk.
So from the Supervising learning we can expect that for a
certain value like the Pink arrow, there is a possibility of Malignant there or
not.
The above scenario can send off 2 classifications like 1
value or 0 value, so we have a multiple options in hand, that is known as
Classification.
From the above diagram we can depict that we have some 5
features to work on and learning algorithm can answer based on 5 features. So
this way supervised algorithm work on features with classifications.
So our learning
algorithm must be able to infinite number of features and that’s what proper
Learning Algorithm is.
Unsupervised Learning
This type of learning doesn’t have any datasets or precisely
no output defined like supervised version (0 or 1). Here given a dataset, user
expects “can you derive some structure from the data”.
So here each red circle belongs to a cluster, so this is known
as Clustering
Algorithm.
Google News uses Unsupervised Clustering Algorithm. If we
open google news under a single topic it shows several hyperlinks and each open
a different page. So we can consider each heading as a cluster of hyperlinks
which open different links.
Hadoop HDFS use
clustering algorithm to split data in each data nodes. When we pass data to
HDFS, we don’t define which data derive what, we just ask HDFS to store them
and ask can we expect anything from data.
Other examples are as following -
Examples of Unsupervised Learning
Given
a large dataset of medical records from patients suffering from heart disease,
try to learn whether there might be different clusters of such patients for
which we might tailor separate treatements.
(This
can be addressed using an unsupervised learning, clustering, algorithm, in
which we group patients into different clusters)
Examine
a large collection of emails that are known to be spam email, to discover if
there are sub-types of spam mail.
(This
can address using a clustering (unsupervised learning) algorithm, to cluster
spam mail into sub-types.)
COCKTAIL PARTY
LEARNING ALGORITHM-
Consider a Group Discussion where more than one guys are
shouting, so sound will be mess. So that is called cocktail party unsupervised
algorithm where this mixed sounds can be separated. We are not about the data,
we just have sounds and we need to extract result from it, so it’s a
unsupervised learning algorithm.
.........
Lot More ......
ABC
1 comment:
Nice one Abhi..
I am happy that you are doing lot many things.. :-)
Post a Comment