News classification based on Naive Bayes

Automatic text classification technology liberates human beings from tedious manual classification, makes the classification task more efficient, and lays the foundation for further data mining and analysis. For news, short news introduction is a high summary of news content. The research on short text classification has always been a researc ...

Posted by tmswenson on Sun, 19 Dec 2021 04:47:56 +0100

1 - text classification + hyper parameter search

If you are opening this notebook locally, please ensure that you have installed the above dependent packages. You can also here Find the multi GPU distributed training version of this notebook. pip install transformers datasets Fine tune the pre training model for text classification We'll show you how to use 🤗 Transformers The model in th ...

Posted by wendu on Sat, 18 Dec 2021 23:53:55 +0100

Analysis and implementation of window TopN

Statement: this series of blogs is compiled according to SGG's videos, which is very suitable for you to learn. Some articles are collected by crawlers and other technical means in order to learn and share. If there is a copyright problem, please leave a message and delete it at any time. The latest version of big data interview questions in 2 ...

Posted by pbaker on Sat, 18 Dec 2021 23:24:22 +0100

Custom metric monitors inflow and output

Statement: this series of blogs is compiled according to SGG's videos, which is very suitable for you to learn. Some articles are collected by crawlers and other technical means in order to learn and share. If there is a copyright problem, please leave a message and delete it at any time. The latest version of big data interview questions in 2 ...

Posted by mrgym on Sat, 18 Dec 2021 19:53:39 +0100

Emotion classification model of Chinese comments based on fine tuning BERT (supporting CPU and GPU)

Migrate Chinese bert Model( chinese-bert-wwm),Complete the emotion classification of more than 20000 comment data, which is divided into 0-Good, 1-General, 2-Poor. Learn bert After the model became powerful, I couldn't help but sigh that the model used in the previous competition was too rubbish to see and think bert Training models to sim ...

Posted by aunquarra on Wed, 15 Dec 2021 09:15:06 +0100

Machine reading comprehension based on BERT model

Reading comprehension task based on BERT pre training model Machine reading comprehension is an important task in natural language processing. The most common is single text extraction reading comprehension. Machine reading comprehension has a wide range of applications, such as customer service robots, which communicate with users through tex ...

Posted by WhiteCube on Sun, 12 Dec 2021 05:50:10 +0100

[CS224n](task3)Dependency Parsing

1, Retrospective dependency parsing Many problems can be transformed into classification problems. The dependency parser based on transfer is transformed from the problem of prediction tree structure to the problem of prediction action sequence. There is one way: Coding end: used to calculate the hidden layer vector representation of words De ...

Posted by findshorty on Sat, 11 Dec 2021 05:22:06 +0100

Construction of Text Cooccurrence Network Based on Python

Catalog 1. Cooccurrence analysis concepts 2. Cooccurrence Types 3. Code implementation 3.1   Construct Word Separator   3.2   String Storage 3.3   Build Dictionary 3.4   Construct Cooccurrence Matrix 3.5   Principal function 3.6   Weight greater than 300 4. Importing Gephi to Make Network Diagram 4. ...

Posted by larus@spuni.is on Wed, 08 Dec 2021 19:12:06 +0100

[original] python artifact for calculating Chinese text similarity

introduce Recently, due to work needs, a function needs to be used, that is, the calculation of Chinese text similarity. It belongs to an application in the nlp field. Here we find a very good package to share with you. This package is called sense transformers. Here's how to use this package to calculate the similarity of Chinese text (it's ...

Posted by Major Tom on Wed, 08 Dec 2021 09:38:42 +0100

Dialogue intention recognition task based on Baidu self-developed model ERNIE

Dialogue intention recognition task based on Baidu self-developed model ERNIE Intention recognition refers to analyzing the core needs of users and outputting the information most relevant to query input, such as finding movies, checking express, municipal office and other needs in search. These needs will be very different in the underlying r ...

Posted by qistoph on Sun, 05 Dec 2021 09:26:54 +0100