Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization(으)로 돌아가기

별점

60,117개의 평가

•

6,959개의 리뷰

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically.
By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow.
The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

NA

2020년 1월 13일

After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.

AM

2019년 10월 8일

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

필터링 기준:

교육 기관: Maximiliano B

•2019년 10월 27일

The second module of the deep learning specialization is excellent. You will learn best practices regarding hyper-parameter tuning, how regularization can be used in Neural Networks, optimization algorithms such as Momentum, RMSProp and Adam. In addition, you will be able to build your first machine model using tensor flow as part of the practical assignments. Professor Andre NG explains the content clearly and it is very pleasant to watch his lectures. I definitely recommend this course because it will give you confidence to build your own models and will provide several additional tools in your tool-belt.

교육 기관: Orson T M

•2020년 9월 13일

Anyone who wants to excel in the field of AI must absolutely follow the 5 courses of this specialization in deep learning offered by the deep learning.ai indeed the courses of the specializations will bring you a deep knowledge of the field because it is important that all those who want to embark on a career in AI, understand the fundamental concepts very clearly, as it will help them to design powerful AI models ready to be exploited for me. I'll help you say start now, not tomorrow. Tomorrow is a loser's excuse. many thanks to deeplearning.ai and coursera to share this knowledge...Orson Typhanel MENGARA

교육 기관: Carson W

•2018년 1월 4일

As with the first course in this specialization, the presentation was spot-on and the content was rich. The practical application is a wonderful tool for learning and I feel as though I have learned much more than I might have in a traditional classroom. I also feel that this course was slightly more challenging than the first, and introduced me to a few concepts I hadn't heard of before despite other research and development in AI/ML. Thank you so much for your dedication to sharing your knowledge and introducing new students to some of the brightest minds in the field with the optional interview videos.

교육 기관: Javier R G

•2020년 10월 15일

Having read some of the other reviews I understand why people feel like the course was too easy and that at the end of it they don't feel confident enough to implement some NN models from scratch. Just to be clear, I feel the same way. However, the intuitions I gained from this course, as well as the last one, helped me to understand at every moment what was being done in TensorFlow, and why, during the last programming assignment. For me this assignment was a smooth introduction to TensorFlow. In general, the videos are clear, concise and prepare you well for the quizzes and the assignments.

교육 기관: Shahin A

•2020년 3월 8일

It is very important for students to feel that the instructor and the education system are in their side, not in the confronting side. I feel like the whole deeplearning.ai course, from design elements to teaching, are in my side, they are here to help me learn. It is great!

The negative side is using TensorFlow1. The python package is clearly an interface to a lower level language, and thus either some background in that language is needed to understand the process better, or it is better to migrate to TensorFlow2. Why TF1 when version 2 is available and it is much easier?

교육 기관: Ali Z

•2018년 11월 1일

small description error on the last project. tensorflow tutorial project.

X, Y = create_placeholders(12288, 6)

print ("X = " + str(X))

print ("Y = " + str(Y))

X = Tensor("Placeholder:0", shape=(12288, ?), dtype=float32)

Y = Tensor("Placeholder_1:0", shape=(6, ?), dtype=float32)

Expected Output:

X Tensor("Placeholder_1:0", shape=(12288, ?), dtype=float32) (not necessarily Placeholder_1)

Correct this from Y Tensor("Placeholder_2:0", shape=(10, ?), dtype=float32) (not necessarily Placeholder_2)

to:

Tensor("Placeholder_2:0", shape=(6 ?), dtype=float32) (not necessarily Placeholder_2)

교육 기관: Shahed B S

•2018년 5월 31일

This course goes into the various parameters and hyperparameters of deep neural networks, as well as suggestive values for ones we can use. This course is short in duration, but a lot of content is developed in here. It touches in on Tensorflow. The template based assignments provide great intuition for getting right on to the topics being taught, however, I feel there should be scope for more programming assignments where the student should be able to write more of that template as well. All in all, Andrew Ng is a great teacher and it was a pleasure to learn from him.

교육 기관: Κώστας Π

•2021년 3월 5일

first of all, I was very pleased with the organization and the programming of the course. It was compact with fundamental theories and concepts for improving deep neural networks. In particular, this is my second course I have attended on coursera, and I strongly believe that it helped me with my bachelor's thesis in mechanical engineering at Aristotle University of Thessaloniki. Above all, it was a fast-paced lesson including a fast "learning rate", which was quite suitable for me as an engineering student who is trying to finish his first diploma (bachelor) degree.

교육 기관: Jong H S

•2017년 10월 1일

At the time of writing this review, I have completed 3 of the 5 courses. I personally think these 3 courses are not merely courses to fill up the specialization. It is a journey, an incredible one. I will write metaphorically. My journey so far is like becoming a magician with Course 1 on how to become one, then went on to Course 2 to learn from the master magicians, their secrets revealed and Course 3 on what to do to put up a good show at Las Vegas trying to fool Penn and Teller. This specialization is my treasure vault. Great job to Prof Andrew Ng and team.

교육 기관: Vincent F

•2018년 1월 23일

This course provided me with an understanding of the large number of hyper parameters that have to be tuned during a deep learning project. It gave me an insight on when different techniques like regularization and (the many different forms of) optimization need to be applied. The only quibble I have is that the material on the choice of the number of layers and the number of hidden units per layer was thin. Given that these values have a great impact on the speed of progress in a deep learning project I would have liked to have seen a little more emphasis on them.

교육 기관: Ernest S

•2017년 11월 5일

This course offers ground knowledge in all mayor concepts of non-recursive neural network and is excellent preparation to further exploring of this topic. Lectures cover broad choice of topics and discusses many problems you might encounter during your journey. Professor Andrew Ng explains theory in a way which builds good intuition and gives you building blocks for face the challenges of machine learning. If you are fluent with calculus or have academic background and expect to discover math behind the scenes I think you will be content too. I surely was.

교육 기관: Aditya B

•2019년 1월 12일

The concepts has been explained in a fantastic way. But few suggestions:

-> After every lesson, I would love to have more pop quizes. This was the case with course 1, but I didnot get any pop quizes for this one.

-> In the quiz assignment, it would be nice to have an explanation or justification section, which will explain that why the option selected is a correct one and why the other options are incorrect. I know we can have the same discussion in the forums, but such an explanation ( one liner should be fine) can provide a good instant knowledge boost!

교육 기관: Rob S

•2018년 6월 9일

Another very well done course. You do a good job describing the benefits of Batch Norm, a lot more intuitively than presented in Szegedy's paper, which is pretty math heavy. However, I did notice one little ERROR on the Tensorflow project page, albeit an insignificant one. Double check that the expected output shape for the cell that outputs the shape of the training set and testing set. One of the expected outputs said that the test set should have 10 possible classes, when the dataset is for 0-5 fingers. This would be a very strange looking hand ;)

교육 기관: David M

•2017년 8월 31일

This is a practical course on how to work with neural networks. It covers a collection of "tips" and techniques, all grounded on a solid theoretical framework, to make a classifier train faster and be more accurate. The explanations are all engaging and interesting, and the assignments are rather easy.

The knowledge gained from this course is probably what everybody working in machine learning already knows, but if you are new to the field this is a great way to get up to speed fast and start implementing neural networks for your own projects.

교육 기관: Jairo J P H

•2020년 2월 1일

El curso es muy bueno, particularmente estoy muy agradecido con COURSERA, por darme la oportunidad de hacer los cinco cursos de la Especialización en Deep Learning con ayuda economica y permitirme tener acceso a este tipo de capacitacion y certificacion. Muchas Gracias…!

The course is very good, particularly I am very grateful to COURSERA, for giving me the opportunity to do the five courses of the Deep Learning Specialization with financial aid and allowing me to have access to this type of training and certification. Thank you very much!

교육 기관: Yash P

•2020년 12월 29일

The First course was the easiest of all the tutorials I could have found on the internet. Andrew Ng has taught it very well, and it's best suited for beginners. The second course has delved deeper into understanding various Optimization Algorithms and improving Deep Learning models by tuning Hyperameters and regularization.

I would strongly recommend you to take this course. It's a very beginner-friendly course, so no need to worry. If you have guts and passion for it, then what are you waiting for, just enroll...!!!!

교육 기관: Dante K

•2020년 12월 1일

This course began similar to the first one in the Specialization, repeating lots of material from Andrew's ML course, but after the first week there's a lot of new material introuced. Andrew shows lots of techniques taken from recent papers that have had much success, which is something you probably won't see in ANY other DL course. Loved the intro to TensorFlow in the last week, really good job at explaning and using the basics without getting too bogged down on the details. Can't wait to do course 3!

교육 기관: GEORGE A

•2019년 3월 5일

Pretty solid class, learned a lot of basic concepts. The class won't go into a lot of mathematical details about the algorithms however, there is enough intuition provided in order to understand the inner workings of the algorithms and the logic behind them. The only con I have is that some of the programming exercises look outdated with the current versions of the notebook. For example, in my last exercise I couldn't make the NN with tensorflow to work properly but got 100/100 nevertheless.

교육 기관: Matei I

•2019년 2월 1일

This course covers details about neural network implementations that are extremely useful in practice. In fact, after completing week 1 and learning about vanishing gradients, I was finally able to debug a NN implementation that I had been struggling with. I'm also grateful for the introduction to Tensorflow. As with the previous course in this specialization, expect to be spoon-fed during the programming assignments. The course would be better if it let you think more during assignments.

교육 기관: Pablo G G

•2020년 9월 10일

Awesome introduction and guidance about where to tweak your model...altho in my expirience Adam is all you are going to need. Missed some teachings about fine tuning thought iterations with scheudeles! Tensorflow has this funciong than can adapt on the go your parameters so your optimization can push that loss lower and lower. Adam optimizer works like charm with an schedule for learning rate!!(https://www.tensorflow.org/api_docs/python/tf/keras/optimizers/schedules/LearningRateSchedule)

교육 기관: 江小鱼

•2019년 2월 12일

This time , I finished Regularzation, I think this is a interesting experience, for you can implement your alg step by step, I get some magic(not black magic) alg, like RMS, momentum and Adam. At last, the most fascinating is to construct Tensorflow, just like a pipeline, step by step , and every step was made by only one line, from forward (without backward) to the model, Tensorflow is really black magic.

(I have to say Tensorflow is a bit difficult, forgive my poor English, thanks )

교육 기관: Nathan Y

•2017년 10월 16일

Neural networks are not new. What we learned in this course is some of the critical implementation details/tricks from the past decades of making them work in practice. Going beyond gradient descent, types of regularization, hyperparameter searching we get to a set of robust tools that quickly find good solutions in extremely high dimensional spaces. As Professor Ng says, our understanding of optimization rules of thumb in low dimensional spaces doesn't carry over to deep learning.

교육 기관: José A

•2017년 10월 30일

Seamlessly continues the previous course. If you know the basic structures of Neural Networks, how to initialize weights. Sigmoid, Tangenth, activations, and so forth, this will help you understand terms such as L2 regularization, gradient descent with momentum, RMSProp, Adam, Exponentially weighted averages, and many others.

Don't let the 3 weeks set you off. It has a lot of micro-content material that works on top of the previous work. Thanks to all the mentors for this great course.

교육 기관: Raimond L

•2017년 8월 20일

Really nice course. A lot of good information about how to prepare and divide data for training, hyperparameters optimization strategy, regularization techniques, learning algorithms, mini-batches, batch-normalization and more... Very useful information with clear explanation !!! Highly recommended course.

Very positive course, except tensorflow practical assignment, which caused some stress, because for me that framework is a bit alienating, forcing to look into manual every minute.

교육 기관: P M K

•2017년 11월 26일

Hi, The course content was definitely good and it helped to understand a lot of internals quite easily. I, however have one suggestion, the Introduction to Tensor Flow looked quite fast and could have been done in a better way by giving more slides about TensorFlow and then going on to the examples. Please ensure that you correct any errors pointed by the members taking this course, so that it benefits others and avoids wasting of time and reduces frustration at times.

Regards, PMK

- Google 데이터 분석가
- Google 프로젝트 관리
- Google UX 디자인
- Google IT 지원
- IBM 데이터 과학
- IBM 데이터 분석가
- Excel & R을 사용한 IBM 데이터 분석
- IBM 사이버 보안 분석가
- IBM 데이터 엔지니어링
- IBM 풀스택 클라우드 개발자
- Facebook 소셜 미디어 마케팅
- Facebook 마케팅 분석
- Salesforce 영업 개발 담당자
- Salesforce 영업 운영
- Intuit 부기
- Google 클라우드 자격증: 클라우드 아키텍트 취득 준비
- Google 클라우드 자격증: 클라우드 데이터 엔지니어 취득 준비
- 경력 시작
- 수료증 취득 준비
- 경력 쌓기