Programmer Think

Swin Transformer Author: elfin Source: Swin Original link: https://www.cnblogs.com/dan-baishucaizi/p/14661164.html catalogue abstract1. Introduction2. Related work 2.1 CNN and its variants2.2 self attention mechanism based on backbone structure2.3 self attention / transformers as a supplement to CNNs2.4 Transformer based b ...

Tip: after the article is written, the directory can be generated automatically. Please refer to the help document on the right for how to generate it preface I started to read CS224n when preparing for the retest, which is a well-known course in natural language processing. When I first started learning word vectors, I was confused. Th ...

TCN from "ABA ABA" to "balabalabala" The concept of TCN (why? What problems can be solved)TCN's parents (origin)Introduction to the principle of TCNCode! 1. What is TCN (time domain convolution network, time convolution network) and what can it do Main application directions: Time series prediction, probability predict ...

Abstract: This article will explain the process of natural language processing in detail, the emotion classification algorithm based on machine learning and TFIDF, and compare various classification algorithms (SVM, RF, LR, Boosting) This article is shared from Huawei cloud community< [Python artificial intelligence] 23 Emotion classificatio ...

Tokenizer introduction and workflow Transformers and the pre training model + fine tuning mode based on BERT family have become the standard configuration in the NLP field. Tokenizer, as the main method of text data preprocessing, has become an essential tool. This article takes the AutoTokenizer used in transformers as an example to illustrat ...

preface This article is based on the previous blog Technical / advertising article classifier (I) , some optimizations were made to improve the accuracy from 84.5% to 94.4% 1, Optimization means 1. Add training data In the previous training data set, there were only about 500 pieces of two types of data respectively, and there were ...

pandas, as a necessary toolkit for data processing, records the learning process The default processing object of pandas is DataFrame, which is loaded after installation catalogue 1, Interpretation of the meaning of code examples (1)pd.read_csv and pandas read various pits and common parameters of csv files (2) The entire dataset cannot be ...

Event background Broad and profound China culture has a long history, and idioms are the cream of China's culture. Idioms are mostly composed of four words, usually with allusions or sources. Some idioms are not difficult to understand literally, such as "making a mountain out of a molehill", "catching up from behind" and s ...

Like RNN neurons, LSTM neurons can maintain memory in their pipeline to allow solving sequence and time problems without disappearing gradient problems affecting their performance. Using the ancient poetry data set, the LSTM neural network model is used to train and automatically generate Chinese Tibetan head poetry. import pandas as pd i ...

1, Introduction stay NLP statistical language model This paper has briefly introduced the relevant knowledge of language model. This paper has described the application scenario of language model and some traditional implementation methods. This paper then demonstrates another implementation method of n-gram - neural network. Is this implement ...