Wednesday, August 10, 2016

Machine Learning: The Master Algorithm


ON MACHINE LEARNING

Most of the knowledge in the world in the future is going to be extracted by machines and will reside in machines.
– Yann Le Cun, Director of AI Research, Facebook

MACHINE LEARNING is the automated discovery of Knowledge. With the Internet and sensors everywhere flooding the world with data, the ground for machine learning is extremely fertile. Machine Learning is done by learning algorithms.

Pedro Domingos’ book is a discourse on the quest for the Master Algorithm which is able to learn anything and everything anytime.

However, the quest for a Master Algorithm is by default a quest to know the nature of the learning process, and there are five schools of thought here on just what happens when we are learning so that machines can emulate them. (Dominos call’s them the five tribes of machine learning). 

Each of the tribes have their strong and valid points and any master algorithm would have to take a bit from each tribe.  them. Below, the five tribes of machine learning, and what they do:

1.    Symbolists fill in gaps in existing knowledge and use deduction to synthesize new knowledge. Example tools: Algebra, Set Theory, Boolean Logic.

2.    Connectionists strive to emulate the brain. Example tools: Back propagation artificial neural networks, Deep-Learning neural networks.

3.    Evolutionaries simulate evolution and natural selection to search the data space and evolve generations of virtual chromosomes of knowledge using a fitness function as a selection criterion. Example tools: Genetic Algorithm, Particle Swarm and Ant Colony Optimization.

4.    Bayesians systematically reduce uncertainty through changes in the probability of constantly updated data. Example tools: Markov Chain Monte Carlo simulation, Kalman Filter.

5.    Analogizers strive to find patterns and similarities in data to classify them and reduce noise. Example tools: Support Vector Machine, Nearest Neighbour algorithm and Radial Basis functions.

Each of the above is suitable for certain applications in widely different fields and certainly, it would be a challenge to find a Master Algorithm.



Wednesday, July 13, 2016

Book Review :Superintelligence by Nick Bostrom: Scenarios for the rise of a rogue AI (Artificial Intelligence)



SUPERINTELLIGENCE by NICK BOSTROM (non-fiction): This book posts the various scenarios on the topic of an Artificial Intelligence (AI) machine turning into a Superintelligence and taking over the human race. Not science fiction but based on current technology's projected development into the future.
Scary and chilling when you consider that great minds like Bill Gates, Stephen Hawking and Elon Musk have already given warnings on the dangers that can happen when an AI gets out of control.
We have already experienced the great improvement in the intelligence of search engines, translation software, speech recognition and image recognition in recent years. This is just the beginning
The author shows the the various technical scenarios where a machine AI becomes powerful enough to break free from its human programmers, command resources to exponentially improve its own capabilities, destroy other competing AI and go on to plot a takeover of the human race. In this book, the takeover happens at blinding speed- in a few hours- and humans are powerless to stop it.
The AI spreads into the Internet to expand its hardware capacity and knowledge base. It hacks into the weapons systems of States and controls their activation. It manipulates financial markets to gain economic resources with which it buys the collaboration with greedy humans who will assist it. It controls the media(TV, news sites etc) and biases the information flow in its favour. Using its knowledge of molecular biology and nano technology it can produce anything and any material at lightning speed and create an army of slaves to do its bidding.
And what is the timeline for this? Nick Bostrom believes it could happen this century. From a hunter-gatherer society to an agricultural society took Mankind 200,000 years. From agricultural to industrial society took 1,000 years. And now, the Internet Economy has developed beyond all past expectations in a matter of decades. At the rate in which AI research is progressing, Nick Bostrom's scenarios are not impossible.

* Those who have some knowledge or experience of AI applications whether in speech recognition, machine vision, financial markets high frequency trading algorithms, robotic or military applications will appreciate this book.

# If you think how the Singapore Police always get their man (e,g, the Standard Chartered Bank robber), it is most probably through a very efficient image recognition software that matches the CCTV images with a travel document (visa, passport) image). And it is must be a very intelligent system that is able to see through disguises and changes in looks.

Sunday, July 10, 2016

Evolution In Nature: Lessons For Your Life


EVOLUTION IN NATURE: LESSONS FOR YOUR LIFE. Nature did not have a plan to make a tiger, a horse or Man. It just happened along the way.
Everything in this space-time Universe evolves; including your Life. Evolution is survival of the fittest. But it is not strength or intelligence that determines fitness for survival. It is the ability to adapt to the ever-changing environment.
Those who are able to constantly adapt, survive. Because Evolution has no pre-determined plan nor a targeted path.
Evolution is open-ended. It meanders along adapting to its ever-changing environment. It is affected by, and in turn affects the environment (and its inhabitants). [Coevolution and Feedback Loops].
In the same way, your Life is not pre-determined but meanders along, affected by events and people, and in turn affecting events and people in a feedback loop. What you will be tomorrow depends on what you do today. And what you do tomorrow makes you what you will be the day after tomorrow.

Wednesday, June 15, 2016

Bond Yields and the Stock Market: A Longer Term Perspective



The daily gyrations and noise of the financial markets are these days exacerbated by algorithmic machine-trading. In addition, the high inter-connectedness of global markets and availability of instantaneous information leads to high correlation between all asset classes: equities, bonds, commodities and currencies; leading to higher and higher volatility via feedback loops until it crashes (nothing goes on forever in such Chaos theory models). Like what happens when your electric guitar's signal feedback to the amplifier turns into a howl.
Taking a longer term view helps in taking away the noise to view the fundamentals. The chart below shows US interest rate changes from 1965 to the present, as represented by the yield on 10-tear Treasuries. Superimposed on it, the Dow Jones Industrial Average and Singapore's Straits Times Index. The chart scale is logarithmic and changes are in % for comparability. The second chart shows yields for 5-years so that details can be viewed with greater clarity.
Some observations from the two charts:
- Today's 10-year Treasuries yield of about 1.59 is low but not the lowest. The lowest of 1.35 was sometime in July 2012 when the PIGS (Portugal, Italy, Greece, Spain) had problems with their sovereign debt. (Can't remember whether it was Italy or Ireland. More recently it was Iceland
- But that was temporary and you can see the yields going up rapidly until it reached a peak in 2014.
- However since then it has been on a downward slide except for the period Jan to Jul 2015
- Taking a longer term view. Since 1965, the yields (interest rate) are definitely indisputably dropping. That's a 50 year trend!
- Next thing you may notice is that broadly speaking, stock markets move in opposite direction to bond yields- see the DJIA and STI on the first chart.
- Singapore and its very open economy is vulnerable to all sorts of happenings around the world. See circled 1997 Asian financial crisis and 2008 US sub-prime mortgage crisis.
-As a result of the low interest rate environment,there is economic growth but also asset growth fuelled by debt (asset bubbles)
- China is a such a good example, and many economists expect a day of reckoning soon which will make the impact of Brexit pale in comparison.
Why is a low-interest rate environment so persistent? I don't know the answer. My guess is that it is due to politics and politicians. Every time economic growth slows down for valid structural and cyclical reasons, politicians are afraid that they will loser their votes, or there will be social unrest. And so they prime the pump to let loose the money again.
Scott Lee for you since you seem to be more interested in economics and finance these days.

Tuesday, June 7, 2016

WILL CHINA'S DEBT CRISIS CAUSE A WORLD ECONOMIC RECESSION SOON?


The media, analysts, fund managers and assorted pundits have been increasingly strident about China's huge debt overhang amounting to trillions of dollars; warning that it will trigger a financial and economic crisis not only for China but the world soon. We have seen the effects of the current China slowdown on everything from demand for iron ore to demand for luxury goods, as China's economy forms a larger and larger part of the world economy. The current economic slowdown in China is the result not only of the ongoing Chinese government;s economic structural reforms but also of years of monetary quantitative easing (QE); beginning with the mega economic stimulus of late 2008 which pumped US$600 billion into the economy. This cheap money fuelled the economy, resulting in an overheated real estate sector, over-investment in manufacturing, wasteful projects, underutilised infrastructure. China's demand for commodities such as oil, coal, iron, steel and agricultural commodities triggered an upsurge in the economy of countries that supplied these products.
The current situation is too long to explain but can be summarised by the headline of an article in today's Straits Times " After the Miracle, the Curse of Debt".
Is Doomsday for the world economy coming this year? Economists and analysts are notorious for making wrong forecasts. In this FB post, just for the fun of it I counted the number of articles per month yielded by a Google search of "China Debt Bubble" and "China Debt Crisis". Going by the consensus and Delphi oracle method of statistical forecasting, if anything at all, this chart constructed by me increases the probability of the event mentioned in this post coming true sooner than later.
*** June is an extrapolated figure based on number of posts till 8 June.

Tuesday, May 17, 2016

COMPARING GDP AND ECONOMIC GROWTH OF COUNTRIES IN THIS REGION WITH RELATIVELY SIMILAR POPULATION SIZE*







COMPARING GDP AND ECONOMIC GROWTH OF COUNTRIES IN THIS REGION WITH RELATIVELY SIMILAR POPULATION SIZE*
* Numbers from www.tradingeconomics.com
Attached snip of a spreadsheet compares Australia, Taiwan and Malaysia. These three countries are relatively similar in population size but their GDP, and GDP growth rate are very different because they are different types of economies at different stages of growth, impacted by different factors:
1. Australia: A mature economy, reliant on export of its natural resources and agricultural commodities. But still a force to be reckoned with. A GDP of US$1.4 trillion for a population of just 23 million- more than the GDP of Indonesia (population 250m. GDP US$889bn) Vietnam (popn 92m, GDP US$186bn) and Philippines (popn 102m GDP US$285bn)
2. Taiwan: Now a backwater because of China's rise? Its GDP of US$530bn is still larger than Malaysia's with an almost similar population size, but its growth rate is negative. But note that its jobless rate of 3.9% is lower than Australia's 5.7%.
3. Malaysia: Still growing more developed than Myanmar, Indonesia, Philippines etc. Has the lowest per capita GDP of about US$11,118. Probably has the most potential for growth if other economic, social and political matters are conducive.
4. Singapore:Placed here as a comparison. Second higher per capita next to Australia. But a vulnerable very open economy and current government economic restructuring efforts result in a the lowest growth rate among the four countries here. Also surprising is the high government debt/GDP ratio of 104%. But don't let that alarm you. Its not external debt. It is internal debt and I think its bonds issued to the Central Provident Fund (CPF) to use its money for investment. Please elaborate or correct me if I am wrong Mr Song Seng Wun .Thanks!
An additional snip shows the numbers for the other countries in ASEAN. Note the small size of Myanmar, Laos and Cambodia GDP. In theory Warren Buffet or Bill Gates are worth more than their GDP. But don't forget that all numbers here are in US$ at the prevailing official exchange rate and for these countries, that makes a big difference.
Plus: a chart of per capita GDP of the four countries.

Thursday, February 18, 2016

Sample Menus From My Artificial Intelligence Menu Generator

The Intelli-Menu Generator is a smart menu generator for a one-pot rice meal accompanied by soup. Style of cooking is Chinese and ingredients are mostly found in Chinese cuisine. In its current version the algorithms for combination and selection of ingredients is basic. But later versions will have memory (so as not to repeat a menu or have a big similarity in ingredients between rice dish and soup). User will also have the ability to input by a points system his/her preferences for each ingredient, and system will have output that  has a minimum score.

The system is flawed because it does not have human sense of taste and balance between ingredients and it often ends up being too imaginative for human taste or output bizarre combinations like liver and flower crab soup or mud crab with slice beef and chestnut. Probably the only way to improve it is to provide feedback from its human owners via a rating at the end of each meal. Over time the neural network will learn what the owner likes and output more appropriate meals.