The effect of the ChatGPT is stunning enough, GPT4 provides even more accurate and amazing capabilities. The entire IT industry is currently experiencing a shake-up due to the large models. Every company is trying to develop its LLM to keep up with the tech trend.

It makes me curious: What is the difference between LLM and deep learning that we knew in the past? Here’s some of my rough understanding.

1x1卷积就是卷积核大小为1x1的卷积操作。1x1卷积操作的目的很明确：就是变维（这里的维度是指channels维度的数量，而不是增加或者减少特征维度，这个计算机领域的遣词还是要多打磨啊，不然会很误导）。因此1x1卷积也可以被看作一种全连接层，因为达到了类似的操作和类似的效果。这里对1x1操作具体地进行分析，以助理解。

When using Git to synchronise LaTeX projects, some files should not be committed. These files could be LaTeX temporary files, your final generated pdf document or hidden files made by OS. Followings may need to be added to your .gitignore.

PVOD is a public dataset that contains real photovoltaic power output and weather condition data. The regression of this dataset can be used to forecast PV power.

The code is available on my Github repo SmallSquare/PVOD_Regression. Feel free to correct me😊.

发表于ICLR2021的Vision Transformer已经成为后续Transformer模型在CV领域进一步发展的基石，本文为初代Vision Transformer论文An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale的解读。

Vision Transformer的pytorch实现可以看我放在Github里的实现：Vision Transformer pytorch - Github，欢迎前来star&fork✨✨✨

最近在用学校的服务器训练一些模型，所以整理几个很常用的命令……

✨Check the date of this article before reading!✨

No module named ‘flaxformer’

Recently, Google used more and more models built on JAX and Flax. When I try to run Vision Transformer pretrained models created by Google, I got the following error.

1

ModuleNotFoundError: No module named 'flaxformer'

But I already installed the requirements.txt, I was confused about the error. And the flaxformer can not be installed by using pip install [package name] since it did not release on PyPI.

Windows上的快捷启动会变得缓慢。

Starting with hotkey always run slow on Windows.

快捷键启动指的是诸如win+shift+数字键和Ctrl+Alt+自定义键的快捷键启动方式，比如自定义Ctrl+Alt+T为Windows Terminal的快捷键。

Starting with hotkey means hotkeys like win+shift+num and Ctrl+Alt+custom keyon Windows. For example, people often set Ctrl+Alt+T to be the hotkey of starting Windows Terminal.

今天debug两小时不知道为什么输入的图片画出来颜色怪怪的，以为是通道不对，调了半天发现RGB通道根本没问题，最后发现是pycharm会在深色皮肤下默认反转jupyter notebook输出图片的颜色，吐了。

当使用命令 set-executionpolicy remotesigned 解除Powershell对脚本运行的限制时，目前的用户可能没有被应用新的策略。

When using the command set-executionpolicy remotesigned to allow scripts running on powershell, current user may not be appled the change.