背景

LSTM主要是用于解决递归网络中梯度指数级消失或者梯度爆炸的问题

https://www.youtube.com/watch?v=YCzL96nL7j0&t=267s
LSTM和RNN主要的区别就在于：LSTM有两条记忆链，一条短期记忆，一条长期记忆。

概要

对比了 RNN Encoder-Decoder 和 GRU(new proposed)之间的翻译能力，发现GRU更具优势且能够理解语法。

背景

RNN Encoder–Decoder

因为会把要翻译的语句映射到固定长度的vector所以训练需要的内存空间是固定的且很小，500M和几十G形成对比。
但也有问题：

As this approach is relatively new, there has not been much work on analyzing the properties and behavior of these models. For instance: What are the properties of sentences on which this approach performs better? How does the choice of source/target vocabulary affect the performance? In which cases does the neural machine translation fail?

不够Fancy的地方：

• 随着源句长度的增加，神经机器翻译模型的性能迅速下降。
• 词汇量的大小对翻译效果有很大的影响。

Encoder For Variable-Length Sequences

RNN

递归神经网络(RNN)在变长序列x = ( x1 , x2, … , xT)上通过保持隐藏状态h随时间变化而工作

grConv

这是本文提出的用于替换RNN Encoder-Decoder 中的Encoder的一种新的神经网络，文中称为：gated recursive convolutional neural network (grConv)

Background: RNN

首先介绍了RNN通过hidden state来实现记忆力功能

Gated RNN

[[On the Properties of Neural Machine Translation= Encoder–Decoder Approaches]]

概要

Transformer是一种基于注意力机制，完全不需要递归或卷积网络的序列预测模型，且更易于训练

背景

介绍了Gated-RNN/LSTM的基本逻辑[[Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling]]，指出:
这种固有的顺序性质阻碍了训练示例中的并行化，这在较长的序列长度上变得至关重要，因为内存限制限制了示例之间的批处理，虽然后续有相关工作优化了一些性能，但是基本的限制并没有解除。

代码

https://github.com/hkproj/pytorch-transformer/
https://www.youtube.com/watch?v=ISNdQcPhsts

参考: https://forum-zh.obsidian.md/t/topic/292

文献搜集网站

Google Scholar 114
Connected Papers

总结了各文章之间的 关联度，太直观了

文献管理软件

Zotero

参考仓库: https://github.com/rzeldent/esp32cam-rtsp

Objective

Stream video through wifi using ESP-32-CAM.
The video sources can be accessed by an ip address.

Implemenation

Install PlatformIO plugin in vscode.
Clone the repository

1

git clone --recursive https://github.com/rzeldent/esp32cam-rtsp.git

Use vscode pio to open the project. Wait pio till its configuration is done.

Change the default_envs settings, here I use esp32cam_ai_thinker

If no default_envs is specified, pio will build the project for all platforms

Here we can build and upload the program to the board.

Connect to ESP**** WiFi, and visit http://192.168.4.1 to configure the wifi settings of the board. I choose to my phone’s hot spot.

Then open the monitor to check the ip address (you need to connect your computer to the same LAN (local area network) to visit the ip)

Visit the 192.168.23.142 and you will see the page (similar with the page of http://192.168.4.1):

Click rtsp://192.168.23.197:554/mjpeg/1 and you will see the streaming video:

生无可恋做横向.jpg

Video: https://www.youtube.com/watch?v=QHf7wKMYieo

Standard Toolchain Setup

Guide: https://docs.espressif.com/projects/esp-idf/en/stable/esp32/get-started/linux-macos-setup.html#

ESP_IDF

I directly download the archive with all the submodules included: https://github.com/espressif/esp-idf/releases/tag/v5.3.1

This archive can also be downloaded from Espressif’s download server: https://dl.espressif.com/github_assets/espressif/esp-idf/releases/download/v5.3.1/esp-idf-v5.3.1.zip

cd into the unzip folder (The installation will fail in conda venv)

1
2
3

conda deactivate
./install.sh
. ./export.sh

In ~/.zshrc

1

alias get_idf='. $HOME/esp/esp-idf-v5.3.1/export.sh'

Then each time I need to setup esp32 development environment, I only need to type get_idf.

Some useful commands

1
2
3
4
5
6

idf.py set-target esp32
idf.py menuconfig
idf.py build
idf.py -p /dev/ttyUSB0 -b 115200 flash
idf.py -p /dev/ttyUSB0 -b monitor
idf.py -p /dev/ttyUSB0 flash monitor # combine together

PlatformIO

事实证明pio是最方便的。。
事前安装过pio的vscode插件，直接打开pio的esp32项目就直接可以编译上传以及查看串口监视器。

边看边记的内容

匆忙

在提到主人公的摩托车被修坏时：

P38
当你做某件事的时候，一旦想要求快，就表示你再也不关心它，只想去做别的事。

这个说法用于理解自己为何焦虑实在是太方便了。譬如，如果我急着读完这本书，那大概是因为我确实急着去实验室干活，或者也可能是因为我希望在周末前读完方便周末回家把书带给老爸看看。如果是前者，那么就把该干的事情搞定再来看书，不是因为实验室的事情重要，而是因为机械性的干活（至少目前负责的横向项目确实如此）确实可以以一种事不关己，旁观的，匆忙的态度快速完成，但看这本书显然不能如此。

感恩

虽然天气很冷，但不至于这么冷，约翰和思薇娅是怎么度过明尼苏达的寒冬的呢？我纳闷。从这里我们可以发现明显的矛盾，如果他们无法忍受生理上的不适，而同时又无法接受科技的成果，那他们一定得做些让步。他们一方面需要科技，一方面又诅咒它。我相信他们很明白这一点，而这正是他们对整个环境不满的原因。他们并没有给出一个合理的论点，只是做出直接的反应而已。
现在三个农夫们进城炫耀着他们新捣鼓来的卡车和洗衣机，他们珍惜科技却又是最不需要科技的一群人，失去了科技他们可能日子不好过，但可以活得好好的。而约翰，思薇娅，克里斯和我可能一个礼拜之内就死了。这样诅咒科技是不敬的，但是情况就是如此。
又钻进死胡同了。如果有人不懂心存感激，而当你当面告诉他，那么就等于是在骂他，这样你什么事情都解决不了。

确实是生活中有太多相关实例了。

原来你当过疯子

Routine

希望可以每天看两个小时论文
爱心屋签到： aixinwu.sjtu.edu.cn/products/asw-store
中午12点抢羽毛球场
午/晚饭后乌灵💊
每日二GRISSO💊

Non-routine

Due

Moved to [[2025 Winter Schedule]]

No Due

Moved to [[2025 Winter Schedule]]

有生之年系列

Moved to [[2025 Winter Schedule]]

Archived

• 交登记表9/23 🔒Done! 2024-09-23 🕸️ 2024 Fall > Routine > Non-routine
• 501 self-introduction 9/24 🔒Done! 2024-09-24 🕸️ 2024 Fall > Routine > Non-routine
• Live2d 重置 [[live2d 复活计画]] 🔒Done! 2024-09-25 🕸️ 2024 Fall > Routine > Non-routine
• 实验室设备准备 🔒Done! 2024-09-26 🕸️ 2024 Fall > Routine > Non-routine
  • 显示器
    • 发票登记
  • 主机
  • 工位申请
• 苏州博物馆主馆抢票9/28 8:00p.m. 🔒Done! 2024-09-28 🕸️ 2024 Fall > Routine > Non-routine
• 毕设报销后续 🔒Done! 2024-09-30 🕸️ 2024 Fall > Routine > Non-routine
• Transformer 及其变体论文 🔒Done! 2024-09-30 🕸️ 2024 Fall > Routine > Non-routine
• 中国银行卡激活9/30 🔒Done! 2024-09-30 🕸️ 2024 Fall > Routine > Non-routine
• 实验室机箱 🔒Done! 2024-10-05 🕸️ 2024 Fall > Routine > Non-routine
  • 更换硬盘（遗留硬盘还有用处，不能直接格式化）
• Neovim类Cursor插件 https://github.com/yetone/avante.nvim [[Neovim Cursor (avante.nvim)]] 🔒Done! 2024-10-08 🕸️ 2024 Fall > Routine > Non-routine
• 博客添加AI助手 🔒Done! 2024-10-08 🕸️ 2024 Fall > Routine > Non-routine
• 中外合作办学十周年志愿者10/10 🔒Done! 2024-10-10 🕸️ 2024 Fall > Routine > Non-routine
• nvim plugin tutorial [[Basic Neovim Plugin Development Tutorial]] 🔒Done! 2024-10-10 🕸️ 2024 Fall > Routine > Non-routine
  • :h write-plugin
  • :h lua-guide
• 6801 HW1 10/14 🔒Done! 2024-10-13 🕸️ 2024 Fall > Routine > Non-routine > Due
• ColorfulDiff.nvim development 🔒Done!(https://github.com/Chen-Yulin/ColorfulDiff.nvim/tree/v0.0.1) 2024-10-14 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 精神卫生中心-精神科就诊 10/15 13:30~14:00 🔒Done! 2024-10-16 🕸️ 2024 Fall > Routine > Non-routine > Due
• 实验室安全教育414A 10/15 16:00 🔒Done! 2024-10-16 🕸️ 2024 Fall > Routine > Non-routine > Due
• 入学教育二10/16 🔒Done! 2024-10-16 🕸️ 2024 Fall > Routine > Non-routine > Due
• https://www.callforpapers.co.uk/digitaltwin (Human Digital Twin For Improving Ergonomics And Worker’s Well-being) 🔒Done! 2024-10-16 🕸️ 2024 Fall > Routine > Non-routine > No Due
• hyprscroller mode+overview waybar [[Hyprscroller + Waybar]] 🔒Done! 2024-10-17 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 501 inclass 10/18 🔒Done! 2024-10-19 🕸️ 2024 Fall > Routine > Non-routine > Due
• Godot game engine 调研 (https://docs.godotengine.org/en/stable/about/introduction.html#before-you-start) 🔒Done! 2024-10-19 🕸️ 2024 Fall > Routine > Non-routine > No Due
• Jolt physics engine (http://nilssondev.com/posts/my-journey-with-physics)[[Jolt vs PhysX]] 🔒Done! 2024-10-19 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 米羔sama读书会《倦怠社会》10/19 (密院心语20:00～22:00) [[《倦怠社会》读书会p9]][[《倦怠社会》读书会p9]] 🔒Done! 2024-10-20 🕸️ 2024 Fall > Routine > Non-routine > Due
• 新生体检 10/20 🔒Done! 2024-10-21 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 Reading 10/21 🔒Done! 2024-10-21 🕸️ 2024 Fall > Routine > Non-routine > Due
• Godot nvim development env (https://www.youtube.com/watch?v=cLWgjienc_s)[[Godot-Nvim Develop Environment]] 🔒Done! 2024-10-21 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 博客评论区复活 🔒Done! 2024-10-22 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 商学院项目座谈会 10/22 14:30 [[密院罗斯商学院双学位项目]] 🔒Done! 2024-10-22 🕸️ 2024 Fall > Routine > Non-routine > Due
• 新生校规校级学习检测10/21~10/27 🔒Done! 2024-10-24 🕸️ 2024 Fall > Routine > Non-routine > Due
• 501 hw1 10/28 🔒Done! 2024-10-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 project proposal 10/28 🔒Done! 2024-10-30 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6801 Assignment 2 10/30 🔒Done! 2024-10-30 🕸️ 2024 Fall > Routine > Non-routine > Due
• 四格漫画 🔒Done! 2024-10-30 🕸️ 2024 Fall > Routine > Non-routine > No Due
• seminar 11/1 🔒Done! 2024-11-04 🕸️ 2024 Fall > Routine > Non-routine > Due
• 小鹿 11/4 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > Due
• 实验室 Seminar 11/6 14:00-16:00 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > Due
• WW2Naval Mod（让这一切好好结束吧） 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > No Due
  • 修复联机下AA对海bug
  • 船只倾斜对于AA俯仰和航向角的影响
  • UI更改
  • 船舵
  • 船只阻力重置
  • 潜艇相关
    • 水舱
    • 可装填鱼雷
    • 潜望镜舰长
    • 电池
    • 柴油机
    • 电机推进
    • 深弹
    • 水听
    • 声呐呐呐呐呐～
    • 雷达（针对水面以上的目标）
• 螺栓紧固机器人 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > No Due
  • 树莓派供电问题
  • esp32视频实时传输[[ESP32-CAM Video Stream]]
  • 紧固装置联调
  • 支撑轮
  • 角钢角度更改
  • 头部升降步进电机驱动
    • 驱动板购买
  • 支撑轮
    • 设计
    • 组装
• 摇滚史密斯 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 确认24SU TA工资尾款980RMB(十一月) 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 电网AR横向 🔒Done! 2024-11-07 🕸️ 2024 Fall > Routine > Non-routine > No Due
  • 论文润色
    • 公式格式
    • 图片文字大小
  • paper相关图片，更换为贴近工地的渲染物体（通过label image）
    • 物体放置
    • 物体识别（待定）
  • 相关公式
• 约气膜羽毛球场 11/8 🔒Done! 2024-11-08 🕸️ 2024 Fall > Routine > Non-routine > Due
• 拿研究生证 11/8 🔒Done! 2024-11-11 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 RA2 11/12 🔒Done! 2024-11-12 🕸️ 2024 Fall > Routine > Non-routine > Due
• 501 introduction 11/12 🔒Done! 2024-11-12 🕸️ 2024 Fall > Routine > Non-routine > Due
• 羽毛球 11/13 🔒Done! 2024-11-12 🕸️ 2024 Fall > Routine > Non-routine > Due
• 绿洲音乐节VIP排票 11/13 12:00 🔒Done! 2024-11-14 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6801 Midterm (CTPP✅, calculator) 11/13 🔒Done! 2024-11-14 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6801 Assignment 3 11/18 🔒Done! 2024-11-20 🕸️ 2024 Fall > Routine > Non-routine > Due
• 501 OH 11/18 19:00 🔒Done! 2024-11-20 🕸️ 2024 Fall > Routine > Non-routine > Due
• CosyPose 12/5 [[Cosypose (multi-view) Adaption]] 🔒Done! 2024-11-20 🕸️ 2024 Fall > Routine > Non-routine > Due
• 爱欲之死 [[《爱欲之死》读书会p12]] 🔒Done! 2024-11-20 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 501 final presentation 11/21 🔒Done! 2024-11-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 读书会[[《学做工：工人阶级子弟为何继承父业》读书会p11]] 11/23 🔒Done! 2024-11-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 绿洲音乐节 11/24 15:00-21:00 🔒Done! 2024-11-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 RA3 11/26 🔒Done! 2024-11-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 学做工：工人阶级子弟为何继承父业~/Book [[《学做工：工人阶级子弟为何继承父业》读书会p11]] (只看了一半) 🔒Done! 2024-11-27 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 6903 Individual Paper https://dl.acm.org/doi/10.1145/3620666.3651367 11/28 (summary page, be in time, 9min) 🔒Done! 2024-11-28 🕸️ 2024 Fall > Routine > Non-routine > Due
• 羽毛球 12/3 气膜 🔒Done! 2024-12-03 🕸️ 2024 Fall > Routine > Non-routine > Due
• MS2 闲鱼寄出 12/3 🔒Done! 2024-12-03 🕸️ 2024 Fall > Routine > Non-routine > Due
• 买买买 🔒Done! 2024-12-03 🕸️ 2024 Fall > Routine > Non-routine > No Due
  • 桌灯
  • 收纳柜
  • 刷子
  • Ibanez GRG220PA1
  • Buffer调音器
  • THR10II 音箱
  • 键盘抽屉
• 约12点气膜羽毛球 🔒Done! 2024-12-04 🕸️ 2024 Fall > Routine > Non-routine > Due
• 琴房 12/6 9:00 am 🔒Done! 2024-12-06 🕸️ 2024 Fall > Routine > Non-routine > Due
• 《第七天》[[《第七天》读书会p13]] 🔒Done! 2024-12-06 🕸️ 2024 Fall > Routine > Non-routine > No Due
• SR concert 12/7 🔒Done! 2024-12-08 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6801 Project Pre 12/11 10min 🔒Done! 2024-12-10 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6801 HW4 12/11 🔒Done! 2024-12-10 🕸️ 2024 Fall > Routine > Non-routine > Due
• 机器人俱乐部午餐会 12/11 12pm 🔒Done! 2024-12-11 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 Project Pre [[FLamby]] 12/12 🔒Done! 2024-12-12 🕸️ 2024 Fall > Routine > Non-routine > Due
• 各种发票(https://sjtu.feishu.cn/sheets/shtcnoqVzifk0yMeDdji7VTb0He) 🔒Done! 2024-12-13 🕸️ 2024 Fall > Routine > Non-routine > No Due
  • 步进丝杆
  • 型材
  • 树莓派供电
  • DM542
  • 直流驱动板
  • 滑轮
  • 键鼠
  • 3D打印#1
  • 3D打印#2
  • m6螺丝/母/垫片
• 6801 Final Exam 12/16 CRQ 113 2pm 🔒Done! 2024-12-16 🕸️ 2024 Fall > Routine > Non-routine > Due
• 逛逛expo~~ 12/18 🔒Done! 2024-12-18 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 Final Exam 12/19 DZY 3-105 🔒Done! 2024-12-19 🕸️ 2024 Fall > Routine > Non-routine > Due
• 6903 Project [[FLamby]] 12/19 src, 12/20 lsj report 12/22 submit 🔒Done! 2024-12-19 🕸️ 2024 Fall > Routine > Non-routine > Due
• 糕的读书会 12/21 SJTU徐汇校区 🔒Done! 2024-12-21 🕸️ 2024 Fall > Routine > Non-routine > Due
• 取羽毛球 12/22 🔒Done! 2024-12-23 🕸️ 2024 Fall > Routine > Non-routine > Due
• 代领xhm毕业证 12/23 🔒Done! 2024-12-23 🕸️ 2024 Fall > Routine > Non-routine > Due
• 高中同学羽毛球局 12/23 🔒Done! 2024-12-23 🕸️ 2024 Fall > Routine > Non-routine > Due
• 二十花剧本杀 12/24 长寿路 🔒Done! 2024-12-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 实验室桌更换 12/31 🔒Done! 2024-12-26 🕸️ 2024 Fall > Routine > Non-routine > Due
• 红课论文 12/31 🔒Done! 2024-12-29 🕸️ 2024 Fall > Routine > Non-routine > Due
• cosypose adaption 12/31 🔒Done! 2024-12-29 🕸️ 2024 Fall > Routine > Non-routine > Due
• 实验室电脑维修 🔒Done! 2024-12-29 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 寒假去哈尔滨玩(否决) 🔒Done! 2024-12-29 🕸️ 2024 Fall > Routine > Non-routine > No Due
• 高中同学吃饭 12/30 🔒Done! 2024-12-31 🕸️ 2024 Fall > Routine > Non-routine > Due
• 旧狮子王 1/7 🔒Done! 2025-01-15 🕸️ Routine > Non-routine > Due
• 电网论文整理 1/8 🔒Done! 2025-01-15 🕸️ Routine > Non-routine > Due
• 看完Imitation learning下的论文 1/4 🔒Done! 2025-01-15 🕸️ Routine > Non-routine > Due
• SLR gun assembly 🔒Done! 2025-01-15 🕸️ Routine > Non-routine > Due > No Due