Programmer Think

2021SC@SDUSC 0. Preface This blog post is mainly about the self attention mechanism of deep learning, qkv part and gradient in deep learning 1. Self attention mechanism of deep learning 1.1 basic concepts of self attention mechanism For the self attention mechanism, Q, K and V, that is, query, key and value, all come from the same inpu ...

Chapter VI fundamentals of visual processing 6.1 introduction to convolutional neural network          The convolution neural network is composed of one or more convolution layers and the top fully connected layer (corresponding to the classical neural network), as well as the correlation weight and Poo ...

0. Why choose OpenCV for reasoning           It is reasonable to use OpenVINO reasoning Suite (engine) for optimization and accelerated reasoning, or other reasoning Suites for reasoning, such as TensorRT, etc. OpenVINO It is a comprehensive tool suite launched by Intel for rapid deployment of applications and solutions. T ...

There are excellent tutorials on the official website of Pytorch. Among them, several short articles belong to the content of the small column called DEEP LEARNING WITH PYTORCH: A 60 MINUTE BLITZ. Considering that it is a little difficult for everyone to read English literature, the author plans to spend some time on translation and make some c ...

         Chapter 9 optimization methods and regularization          Almost all deep learning is supported by a very important algorithm: random gradient descent (SGD).          So far, we have a deep understanding of the con ...

catalogue 1, Install OpenCV3.4.11 1.1 download and unzip the installation package 1.2 installing opencv 1.3 environment configuration 2, Linux picture programming 3, OpenCV about the use of cameras three point one   Get camera permissions for virtual machine 3.2 playing video   three point three   record video 3.4 prob ...

This project is a major assignment of the course "optimal control" taught by Le Xinyi in the fall semester of Shanghai Jiaotong University in 2020. Most of the content is based on the work of senior Fang Xiaomeng, "Research on multi manipulator cooperative control technology based on neural network algorithm". Recently, due ...

TD3 code implementation Code and explanation 0. Operating environment Equipment / packageeditionpython3.7.11Graphics cardGTX 1050CUDA10.2cudnn7.6.5cudatoolkit10.0.130tensorflow-gpu2.2.0tensorlayer2.2.3tensorflow-probability0.9.0 1. Package introduction and parameter setting import argparse import os import random import time i ...

It should be noted that the following contents are obtained from teacher Li Hongyi's course. Homework 1: Linear Regression This goal: PM2.5 in 10 hours predicted by 18 features (including PM2.5) in the first 9 hours. Load 'train.csv' The data of train.csv is 12 months, 20 days a month and 24 hours a day (18 features per hour). import s ...

In the last chapter, we introduced the basic principle of convolutional neural network. In this chapter, we will take you to understand the structure of modern convolutional neural network. Many studies of modern convolutional neural network are based on this chapter. Although the concept of deep neural networks is very simple - stackin ...