Tianchi zero foundation entry NLP competition practice: Task1&Task2 data reading and data analysis
Task 1 & Task 2 data reading and data analysis
The game data is text data, and each news is of variable length, which is stored in csv format. Therefore, you can directly use Pandas to complete the data reading operation.
import pandas as pd
train_df = pd.read_csv(r'train_set.csv', sep='\t')
pd.read_csv common parameters:
The read file ...
Posted by ozman26 on Sun, 24 Oct 2021 21:26:40 +0200
Image classification project: make your own TFRecord data set, read and display (detailed illustration)
Customize the data set and model, and call the image classification project of pb model compiled by tensorflow with QT and c + + Step 1: This article Step 2: Read the custom TFRecord data set, train the convolution network and save the pb model Step 3: opencv reads the customized pb model, customizes softmax and argmax functions, and ...
Posted by D on Sat, 23 Oct 2021 04:20:01 +0200
python3 seq2seq_convert.py corresponds to code interpretation extraction + generative extraction summary code interpretation ------ summary code interpretation 4
View the contents of the main function and read the file first
if __name__ == '__main__':
#data_extract_json = /home/xiaoguzai / code / French research cup text summary / datasets/train_extract.json
data = load_data(data_extract_json)
data_x = np.load(data_extract_npy)
data_seq2seq_json = data_json[:-5] + '_seq2seq.json'
co ...
Posted by Jocka on Fri, 22 Oct 2021 08:52:18 +0200
MNIST handwritten numeral recognition based on PyTorch
Recently, I'm learning neural networks. Here's a little practice. This article is reprinted, Click here to jump to the original text.
1. Environment configuration
PyTorch is used here to train the model. The installation of PyTorch seems to have something to do with the machine's graphics card. You can search the installation tutorial online. ...
Posted by freelancedeve on Fri, 22 Oct 2021 05:01:40 +0200
Torchvison dataset and dataloader use
Use of Torchvison-dataset
Here are some of the ways in which database datasets are used in Torchvision. First we can see many datasets in Torchvision in the Pytorch Watch: With CIFAR as an example, you can learn more about the dataset when you point in: The settings and functions of some parameters when calling the database are described her ...
Posted by owned on Wed, 20 Oct 2021 20:20:43 +0200
Cesium intermediate tutorial 1 - spatial data visualization
This tutorial will teach readers how to draw spatial data such as points, markers, labels, lines, models, shapes, and objects using cesium's Entity API. Cesium's prior knowledge is not required, but if the reader has no experience in this field at all, the reader may want to learn from it "Beginner's Chinese tutorial (original)" Start ...
Posted by aneuryzma on Wed, 20 Oct 2021 01:41:17 +0200
Handwritten numeral recognition based on LeNet
1. Experimental contents
MNIST data loading and visualization Read the relevant materials and papers of LeNet-5 and implement the network layer by layer under any framework of Keras, tensorflow or pytoch Construction of network model Model training is implemented on MNIST data set to evaluate model performance indicators Take a photo c ...
Posted by theelectricwiz on Mon, 18 Oct 2021 05:18:46 +0200
Undergraduate in-depth learning - the simplest LSTM explanation, multi picture display, source code practice and suggestions collection
catalogue
1. What is lstm
2. Network structure of lstm
1. Architecture diagram
3. lstm's door
3.1 description of input data
3.2 the core of LSTM is three gate functions
3.3 door
3.4 input gate
3.5 output valve
4. pytorch module parameters
5. lstm example
Required packages:
Source code:
6. Summary
It's been a while since the last ...
Posted by jannz on Mon, 18 Oct 2021 02:18:31 +0200
pytorch basic learning
1, Install Anaconda
Download from the official website, select the installation location, select all user, select the configuration environment, and install the rest next.
2, Create virtual environment
Open Anaconda PromptTo create a virtual environment, enter:
conda create --name pytorch python=3.8
Where pytorch is the name of the virtua ...
Posted by foreverdita on Fri, 15 Oct 2021 21:26:16 +0200
Wu Enda's in-depth study - Programming assignment for the second week
1-packges
Before we start, we need to import the following libraries:
numpy: it is a basic software package for scientific computing in Python.h5py: a common software package that interacts with data sets stored in H5 files.matplotlib: is a well-known library for drawing charts in Python.lr_utils: in the package of this article, a library ...
Posted by dreamkiller23 on Fri, 15 Oct 2021 20:48:59 +0200