Into the Unknown
Reinforcement Learning SpecializationUniversity of Alberta Anyone who loves reinforcement learning should not miss this specialization. Thank you University of Alberta! My Specialization Certificate Courses I am Kesler Zhu, thank you for visiting. Checkout all of my course reviews at http://KZHU.ai
A Complete Reinforcement Learning System (Capstone)University of Alberta For moon landing, let’s build a complete Deep RL system. You will get hands dirty in an expected SARSA agent using neural networks as function approximation and Adam as optimizer, also don’t forget softmax and replay buffer, and later parameter study! What an achievement! But meanwhile – as Prof. Martha White and Prof. Adam White pointed out – this is only the “first step towards learning…
Ancient Philosophy: Plato & His PredecessorsUniversity of Pennsylvania Highly recommend! This course is elegant, classy and mind-blowing. It was like a short trip to School of Athens. The words I read, the articulation I heard are sometimes like thunders and storm making me shocked and tongue-tied; sometimes like nocturne and lullaby making my life easy and…
Prediction and Control with Function ApproximationUniversity of Alberta This course reaches the apex of the entire reinforcement learning specialization! Don’t even bother ? if you are not ready for supervised learning and neural networks. The last topics policy parameterization and Actor-Critic algorithm are really the shiny pearls of the crown. Love it. A round of applause to Prof. Martha White and Prof. Adam White. Thank you very…
Physics 101 – Forces and KinematicsRice University Howdy! Prof. Jason Hafner! I haven’t completed the whole specialization yet, but I can’t wait to say “THANK YOU”! This “chalk-n-board” course really has made me feel quite nostalgic! And I never expect a physics course can be so jolly and cheerful. I burst into laughter for quite a few times…
Sample-based Learning MethodsUniversity of Alberta I had a terrific time! This course covers quite a few fundamental & crucial reinforcement learning algorithms: Temporal Difference, SARSA, Dyna-Q, their variants, and their relationship with Dynamic Programming, Monte Carlo covered in previous course. The well-prepared programming assignments are both challenging and enlightening – helping me comprehend those complicated algorithms. My…
Fundamentals of Reinforcement LearningUniversity of Alberta Many thanks to Prof. Martha White and Adam White for this great reinforcement learning course – I wish I could have done this when I was in university. The course teaches fundamental concepts like Bellman equations, dynamic programming , etc. All of them become crystal clear. Finally, 2020 is over, let’s keep learning in 2021. Happy…
Being a researcher (in Information Science and Technology)Politecnico di Milano “La Ringrazio Tanto” to Prof. Carlo Ghezzi for this fantastic course! I am very impressed by the rigorous wording through out the entire course – beautiful and concise. Some topics benefit me a lot: history of science (pertaining to Francis Bacon, Galileo Galilei, Issac Newton); necessary skills like reading, writing, presenting, building artifacts…
Blockchain Business ModelsDuke University Tip my hat to Prof. Campbell Harvey, thank you for this wonderful course. 鈽曪笍 The course is very well structured – starting from rudimentary cryptographic algorithms; then critical topics like cryptocurrency, ethereum, consensus, and caveat of fraudulent ICOs; finally conclude with regulatory environment and landscape of FinTech. Prof. Harvey is a very skilled speaker and presenter, I enjoyed this course very much.Highly recommend this course to those new…
How to Win a Data Science Competition (with Honors)Higher School of Economics This course rocks! ? I found many tips, tricks and techniques very useful, some of them are a bit challenging to me. exploratory data analysis (EDA) is critical; ensembles are powerful; various kinds of hyper-parameters and metrics optimizations are the devil hides in the detail. A successful machine learning model is more…
Transacting on the BlockchainINSEAD This course covers topics smart contracts , identity , and financial services . But to me, this course is more about our society. The word neo feudalism has been ringing in my head. It seems blockchain would be the chosen innovation to overthrow the unequal and imperfect world. I, somehow, doubted that would happen soon. Or, blockchain would be just another tool used by elites to…
Quantum Computing Less Formulas More UnderstandingSaint Petersburg State University My! Oh! My! quantum computing ! This course is stunning! I love the course used plain language to make complicated quantum mechanics topics easy to understand. To me, the quantum teleportation and cryptography topics are profoundly amazing. I am like Alice going down the rabbit hole. Strongly recommend! My Certificate I am Kesler Zhu, thank you…
Introduction to Blockchain TechnologiesINSEAD It is exciting to come across this blockchain course lectured by the world’s leading authorities Don Tapscott and Alex Tapscott. Thank you sir. Videos are brief and concise; many beautiful lines and wise wording often made me pause and ponder. The topic “design principles”, “ecosystem” and “implementation challenges” are very impressive – reminding me of those…
Front-End Web Development with ReactThe Hong Kong University of Science and Technology This course is fantastic! I am currently in a cloud native storage project which needs me at least make sense of its web frontend. This reactjs course really comes to the rescue. Learning by doing, after finishing all exercises and assignments, I built a fully-featured single page application with fantastic…
Front-End Web UI Frameworks and ToolsThe Hong Kong University of Science and Technology This is definitely a course help you go “from zero to hero” in web development! I remember 15 years ago I used html , css , vanilla javascript , jsp , asp, vbscript to build fancy websites. But now I am shocked to see landscape has totally changed. More and more stunning and…