I promised that there would be an update about the USB, here it is. This update would only talk about the USB 2.0 Host on the Pano Logic G1 devices with ISP1760 USB host controller, so it is probably not applicapable to other platforms. The goal here is to write a set of RTL and software stack, so it is possible to use USB HID joystick/ gamepad and USB mass storage devices on the Pano G1. Speed would not be the concern here.

Hardware Connections

On the Pano G1, an USB 2.0 high-speed host controller (Phillips ISP1760) is connected to the FPGA via 16-bit parallel memory bus. To mitigate one of the controller’s errata, an USB high speed hub (SMSC USB2513) is connected to one of the downstream port of the controller, and all user accessible ports are connected to the USB hub.

Overall Architecture

Though it might be possible to write a FSM to implement some basics of the USB host protocol stack, it is just not very practical. (Device side might be more practical, though). The solution I have here is to continue use the PicoRV32 soft-core processor on the FPGA. The host controller would be mapped to PicoRV32’s memory space as MMIO, then software driver and protocol stack can run on the PicoRV32. When needed, certain outputs can be achieved by using MMIO GPIO (for example, output the currently pressed keys). Hopefully, debugging software would be much easier than debugging hardware.

Generally, there would be several layers. The bottom part is called as the HCD (Host Controller Driver), which is specific to particular hardware, like the controller chip being used. Then it comes the HD (Host Driver), this is the part handles device enumeration and USB Hub communication, this layer is no longer specific to the platform. Higher than that is the class driver, as name suggests this is specific to a device class, for example, HID class or audio class. The driver might be generic to the whole class, or it might just support one of few specific USB devices. Higher than that, usually it is operating system, or in our case, user application.

In conclusion, there are 5 things I need to do:

1. Write the RTL to interface ISP1760 with PicoRV32
2. Port or write the HCD for ISP1760
3. Port some appropriate host driver over
4. Port or write the class driver for HID gamepad and mass storage devices
5. Write some application code to use the driver

Let’s discuss all these parts.

#安装编译依赖
sudo apt-get install cmake git libgtk2.0-dev pkg-config libavcodec-dev libavformat-dev libswscale-dev
sudo apt-get install python-dev python-numpy libtbb2 libtbb-dev libjpeg-dev libpng-dev libtiff-dev libjasper-dev libdc1394-22-dev

#新版本 Ubuntu 的源中没有 libjasper-dev 手动添加源
sudo add-apt-repository "deb http://security.ubuntu.com/ubuntu xenial-security main"
sudo apt update
sudo apt install libjasper1 libjasper-dev

#创建编译目录：
mkdir opencv-build

#下载 OpenCV 源代码：
git clone https://github.com/Itseez/opencv.git

mkdir build
cd build

#创建 cmake 编译信息：
cmake -DENABLE_VFPV3=ON -DENABLE_VFPV4=ON -DENABLE_NEON=ON -DCMAKE_TOOLCHAIN_FILE=../opencv/platforms/linux/arm-gnueabi.toolchain.cmake ../opencv

#编译：
make -j4
make install

东西都在 ./install 目录下了。

编译自己的应用时注意 opencv2 头文件都是在 opencv4 文件夹下的。 编译参数：

OPENCV_INCLUDE=$(LIBPREFIX)/include/opencv4
-I$(OPENCV_INCLUDE)
-lopencv_core -lopencv_imgproc -lopencv_highgui -lopencv_ml -lopencv_video -lopencv_features2d -lopencv_calib3d -lopencv_objdetect -lopencv_flann

这个屏幕是给VerilogBoy实体机使用的屏幕，MIPI DSI接口，因为以前从来没有点过MIPI的屏幕，这里记录下过程方便以后参考。

基本信息

• 型号：AML-B16C15012Q
• 类型：RGB IPS TFT-LCD
• 模式：Normal Black
• 分辨率：320x320
• 灰度：接口支持8bpc，内部显存为6bpc，实际输出可能为6bpc
• 控制器：ST7796S
• 尺寸：1.54"
• 接口：MIPI 1-lane
• 背光：3并，VF=3.2V

接口定义

1. LEDA
2. LEDK
3. VCC 2.8
4. RESET
5. NC
6. NC
7. NC
8. VCCIO 1.8
9. GND
10. DATA0_P
11. TE
12. DATA0_N
13. NC
14. GND
15. GND
16. CLK_P
17. NC
18. CLK_N
19. NC
20. GND

首先，感谢 @andy=Lithia 大佬赠送的屏幕！这次这个确实不是之前一直在点的液晶屏幕，这次是LED微型点阵。由于懒得写字，直接放图算了……（真好看啊）

前言