My repository: https://github.com/Chen-Yulin/Semantic-SAM

Installation

官方步骤：

1
2
3
4
5
6
7
8

pip3 install torch==1.13.1 torchvision==0.14.1 --extra-index-url https://download.pytorch.org/whl/cu113
python -m pip install 'git+https://github.com/MaureenZOU/detectron2-xyz.git'
pip install git+https://github.com/cocodataset/panopticapi.git
git clone https://github.com/UX-Decoder/Semantic-SAM
cd Semantic-SAM
python -m pip install -r requirements.txt

export DATASET=/pth/to/dataset  # path to your coco data

一些绊脚石 ^ ^

1

根据[[Cuda+Torch]]，需要先安装cudatoolkit和cuda-toolkit

1
2
3
4
5

conda install nvidia/label/cuda-11.7.0::cuda-toolkit -c nvidia/label/cuda-11.7.0 
conda install cudatoolkit # no need to specify version
conda env config vars set LD_LIBRARY_PATH="/home/cyl/miniconda3/envs/<name>/lib/"
conda env config vars set CPATH="/home/cyl/miniconda3/envs/<name>/include/"
conda env config vars set CUDA_HOME="/home/cyl/miniconda3/envs/<name>/"

然后按照torch官网的安装指令：

1

conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia

2

第二行直接运行可能会报错，提示系统gcc版本过高，安装gcc=11.2.0

1
2
3
4
5
6

conda install -c conda-forge gcc=11.2.0
conda install -c conda-forge gxx=11.2.0

# 指定编译器路径
export CC=$CONDA_PREFIX/bin/gcc
export CXX=$CONDA_PREFIX/bin/g++

如果编译时出现ld: cannot find -lcudart: No such file or directory collect2: error: ld returned 1 exit status 报错，只是因为没有安装cudatoolkit ^ ^

3

安装完成后直接import semantic_sam会报错ModuleNotFoundError: No module named 'MultiScaleDeformableAttention' ^ ^
提示：

1
2
3

Please compile MultiScaleDeformableAttention CUDA op with the following commands:
	`cd mask2former[/modeling/pixel_decoder/ops](http://127.0.0.1:8888/modeling/pixel_decoder/ops)`
	`sh make.sh`

需要手动make一下 Mask2Former:

1
2

cd Mask2Former/mask2former/modeling/pixel_decoder/ops/
sh make.sh

4

一些版本问题

1

pip install gradio==3.37.0

Demo 🐱

Generate multi-granularity Mask on CLICK

1

python demo.py --ckpt ./weights/swinl_only_sam_many2many.pth

Comment: 效果相较于SAM更多体现了语义的一致性，而不是基于texture进行分割。

Automatically Generate Mask on Different Granularity

1

python demo_auto_generation.py --ckpt ./weights/swinl_only_sam_many2many.pth

Game

learning git branch

Git Merge

• Git Merge
  • Solve conflict
    • Tools
    • Commands

Solve conflict

Tools

In nvim, I use plugin fugitive

Commands

open two vertical buffer (one form target, another from feature)

1

:Gvdiffsplit!

stay on middle and use

1

:diffget [buffername](local)

OR
go to target/feature buffer and use

1

:diffput [buffername](target/feature)

save the local file and use

1
2

:Git add .
:Git commit -m "solve merge conflicts"

• Add remote repository
• Branch

Add remote repository

1

git remote add origin git@github.com:...

origin is the name of the repository
Check remote repository settings:

1

git remote -v

Before push to remote repository, make sure the branch name is the same.

Branch

find all the branch

1

git branch -a

find all the branch on remote repository

1

git remote -r 

Rename

1

git branch -m oldBranchName newBranchName

Move to branch:

1

git checkout [branchname/SHA-1]

What is a Git submodule?

A Git submodule allows a user to include a Git repository as a subdirectory of another Git repository. This can be useful when a project needs to include and use another project. For example, it may be a third-party library or a library developed independently for use in multiple parent projects. With submodules, these libraries can be managed as independent projects while being used in the user’s project. This allows for better organization and management of the code.

How to add a submodule to a project

To add an existing Git repository as a submodule to a project, the git submodule add command can be used. The command format is git submodule add <url> <path>, where <url> is the URL of the submodule repository and <path> is the storage path of the submodule in the project. For example, if a user wants to add the remote repository https://github.com/username/repo.git as a submodule to their project and store it in the my-submodule directory, they can use the following command:

1

git submodule add https://github.com/username/repo.git my-submodule

This will successfully add a submodule named my-submodule to the user’s project.

• check commit history
• change version
• switch to latest
• need a early version of a repository
  • Fork the latest repository on Github
  • clone the forked repository
  • change the version locally and push

check commit history

1
2

git log
git log --pretty=oneline

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21

commit 0637340f4d8d288a8d24dd5193855c9e5def776d (HEAD -> main, origin/main, origin/HEAD)
Author: Chen-Yulin <chenyulin@sjtu.edu.cn>
Date:   Tue Mar 21 20:55:16 2023 +0800

    modify obsidian dir

commit dde357abf53f26972bd3ad0e1b1e840412b26fc7
Author: Chen-Yulin <chenyulin@sjtu.edu.cn>
Date:   Tue Mar 21 20:54:57 2023 +0800

    modify obsidian dir

commit 089578f74d206c7fbb503a293d34edf878dad3f3
Author: Chen-Yulin <chenyulin@sjtu.edu.cn>
Date:   Tue Mar 21 20:34:09 2023 +0800

    fix plugin compatibility

commit b62c94796b757851a5e8f38925f28b160a8bf4f0
Author: Chen-Yulin <chenyulin@sjtu.edu.cn>
Date:   Tue Mar 21 14:59:02 2023 +0800

change version

1

git reset --hard [version hash]

switch to latest

1

git pull

or locally

1

git checkout master

need a early version of a repository

Fork the latest repository on Github

clone the forked repository

1

git clone ...

change the version locally and push

1
2
3
4

git log
...
git reset --hard [version hash]
git push --force