intern:vitransformer
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
intern:vitransformer [2025/05/04 13:44] – [Week 4: Analysis and Synthesis (September 11–15)] lizhengyu | intern:vitransformer [2025/07/28 08:24] (current) – [Week 2: Collaborative Paper Development (August 28 – September 3)] lizhengyu | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | == Research Activities (August 22, 2023 – September 15, 2023) == | + | == Research Activities (August 22, 2024 – September 15, 2024) == |
=== Week log === | === Week log === | ||
==== Week 1: Foundational Research (August 22–27) ==== | ==== Week 1: Foundational Research (August 22–27) ==== | ||
- | * Reviewed seminal papers on attention mechanisms, including: | + | |
- | * //Attention Is All You Need// | + | * //Attention Is All You Need// |
- | * // | + | * // |
- | * Developed proficiency in Anaconda and Python programming for AI applications. | + | * Developed proficiency in Anaconda and Python programming for AI applications. |
- | * Joined laboratory research under mentorship of senior researchers. | + | * Joined laboratory research under mentorship of senior researchers. |
==== Week 2: Collaborative Paper Development (August 28 – September 3) ==== | ==== Week 2: Collaborative Paper Development (August 28 – September 3) ==== | ||
- | * Supported experiments for the paper // | + | |
- | * Implemented baseline models comparing fine-tuning strategies (last layer vs. full network) for transfer learning. | + | * Implemented baseline models comparing fine-tuning strategies (last layer vs. full network) for transfer learning. |
- | * Formalized mathematical definitions for transfer learning, clustering algorithms, and attention masking in the Methods section. | + | * Formalized mathematical definitions for transfer learning, clustering algorithms, and attention masking in the Methods section. |
- | * Assisted with LaTeX typesetting and document formatting. | + | * Assisted with LaTeX typesetting and document formatting. |
==== Week 3: Data Pipeline Implementation (September 4–10) ==== | ==== Week 3: Data Pipeline Implementation (September 4–10) ==== |
intern/vitransformer.1746380696.txt.gz · Last modified: 2025/05/04 13:44 by lizhengyu