Programming Assigment 1

Acknowledgement: We expect you to make an honest effort to solve the problems individually. As we sometimes reuse problem set questions from previous years, covered by papers and web pages, we expect you NOT to copy, refer to, or look at the solutions in preparing your answers (relating to an unauthorized material is considered a violation of the honor principle). Similarly, we expect you not to google directly for answers (though you are free to google for knowledge about the topic). If you do happen to use other material, it must be acknowledged in your submission.
Required homework submission format: You should directly write your codes and answers in attached jupyter notebook files. Pay attention to the comments and instructions to see which parts need to be changed exactly. The teaching assistant will grade your assignment mainly based on the rightness of your programming implementation and rationality of your analytical answers.
Collaborators: If you collaborated with others on any questions, list the questions and names of collaborator. Even if you acknowledge your collaborators, your solution should be written completely using your own words.

In PA1, you will be given two problems which is related to linear regression with regularization and logistic regression. You will see two jupyter notebook files named ridge_regression.ipynb and logistic_regression.ipynb respectively. We recommend you to complete ridge_regression.ipynb first. You need to write your codes and answer questions by directly editing these two files. If you have trouble to deal with jupyter notebook, ask TA (wlsdzyzl@163.com) for help.
You are expected to only use numpy packages to implement the algorithms.
You are free to change the codes if you know what you are doing. Play with different parameters could help you give some more comprehensive answers to analytical questions.
After finishing your assignment, you should pack all related files into one zip file. Note that ridge_regression.ipynb and logistic_regression.ipynb must be included. Then submit it to the THU's web learning page.