Programmer Think

catalogue preface 1, Data loading 1. Load package 2. Read data II. Text processing 1. Remove useless characters 2. Text segmentation 3. Remove stop words 4. Remove low-frequency words 5. Divide training set and test set 3, Convert text into vector form 1. Convert text into TF IDF vector 2. Convert text into word2vec vector 3. Conv ...

44_Pandas converts classified variables into dummy variables (get_dummies) To convert categorical variables (categorical data, qualitative data) into virtual variables in pandas, use pandas get_ Dummies() function. Data such as gender classified by string can be converted into 0 for men and 1 for women, and multi class features can be convert ...

definitionLabel smoothing, like L1, L2 and dropout, is a regularization method in the field of machine learning. It is usually used for classification problems. The purpose is to prevent the model from predicting labels too confidently during training and improve the problem of poor generalization ability.backgroundFor the classification proble ...

Python packaging tool Pyintealler packaging py file is windows exe file process and stepping on pit record + practical example catalogue Python packaging tool Pyintealler packaging py file is windows exe file process and stepping on pit record + practical example install Model building code Packing and pit stepping records install ...

No reprint!!! The general activation function has the following properties: Nonlinear When the activation function is linear, a two-layer neural network can basically approximate all functions. However, if the activation function is an identical activation function, that is, f(x)=x, this property is not satisfied. Moreover, if the MLP use ...

In today's article, we are formally exposed to the theoretical basis of deep learning - machine learning 1, Machine learning classification 1. Based on subject classification Statistics, artificial intelligence, information theory, control theory 2. Classification based on learning patterns Inductive learning, explanatory learning and feed ...

Original link: http://tecdat.cn/?p=18726 Original source: Tuo end data tribal official account_ Self organization_ Mapped neural network (SOM) is an unsupervised data visualization technology, which can be used to visualize high-dimensional data sets in low-dimensional (usually 2-dimensional) representation. In this article, we studied how to u ...

[source code analysis] deep learning distributed training framework horovod (9) - start on spark 0x00 summary Horovod is an easy-to-use high-performance distributed training framework released by Uber in 2017, which has been widely used in the industry. This series will lead you to understand horovod through source code analysis. These a ...

Objective: to complete the Titanic survival prediction based on the Titanic data set. import pandas as pd import numpy as np import matplotlib.pyplot as plt import seaborn as sns from IPython.display import Image plt.rcParams['font.sans-serif'] = ['SimHei'] # Used to display Chinese labels normally plt.rcParams['axes.unicode_minus'] = False ...

Introduction to machine learning for programmers (IV) - common skills in the training process This article will focus on some common skills in machine learning training using pytorch. Mastering them can make you get twice the result with half the effort. Most of the codes used will be based on the last example in the previous article, that is ...