Background

Recently, in a company's equipment, the built-in DTU sends 16-digit data messages to the server through UDP. Because of the first contact with this kind of data analysis method, we summarize and reflect here to avoid detours.

II. Summary of Contents

2.1 Creation of UDP Communication Server

step

1. Create UDP socket communication mode.
2. Bind specific ports.
3. Setting up port multiplexing wait (this step can be omitted)
4. Get data.
5. Send data to client.
6. Parse and store data.
7. Close the socket link for UDP.

Following are the explanations and summaries, which are adopted. MVP Complete all the above steps in a way that does not extend too much:

1. Create UDP socket communication mode.

import socket
Server = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)

2. Binding specific ports

Server.bind("", 8600)

Setting up port reuse waiting (this step can be omitted)**

Server.setsockopt(socket.IPPROTO_IP, socket.SO_REUSEADDR, 1)

4. Data acquisition

Msg, ClientAddr = Server.recvfrom(1024)

5. Send data to client

Server.sendto(Data)

6. Parsing data

Data = binascii.b2a_hex(Msg)

7. Close the socket link for UDP

Server.close()

2.2 16-digit data parsing

1. Packet Time Resolution

Time = datetime.datetime.strptime(Data[26:38], "%y%m%d%H%M%S")  # Resolution time

2. Converting hexadecimal system to 10-decimal system and then to ASCII code

chr(int(Data[224 + (i - 2):224 + i],16))

2.3 File Creation and Data Storage Analysis

I have to say that I encountered a lot of pits when I stored data files.
Pit 1: How to automatically create folder structure of year - > month - > day?

if not os.path.exists(NewPath):
    os.makedirs(NewPath)

if not os.path.isdir(FileDir):
     os.makedirs(FileDir)

These are all the mistakes I have summarized. I hope you can avoid these pits when you read this post. Below is my complete UDP message receiving and parsing code:

#!/usr/local/bin/python3
# coding:utf-8

import socket
import binascii
import datetime
import os
import csv

'''
//Author: Zflyee
Mailto: zflyee@126.com
'''

Server = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)  # Create UDP to transfer data
# Server.setsockopt(socket.IPPROTO_IP, socket.SO_REUSEADDR, 1)    # Fast Implementation of Port Multiplexing

Server.bind(("", 8600))
print(u"Binded native port:8600,Data is being monitored...")


def DataParsing(Data):
    Time = datetime.datetime.strptime(Data[26:38], "%y%m%d%H%M%S")  # Resolution time

    Voltage = int(Data[44:46], 16) / 10.0  # Voltage data

    Temp = int(Data[60:64], 16) / 10.0  # Real-time temperature data

    Temp_1h_max = int(Data[70:74], 16) / 10.0  # Hourly maximum temperature

    Temp_1h_min = int(Data[80:84], 16) / 10.0  # Minimum Temperature Hour

    Hum = int(Data[90:94], 16) / 10.0  # Humidity data

    Hum_1h_max = int(Data[100:104], 16) / 10.0  # Maximum Humidity Hour

    Hum_1h_min = int(Data[110:114], 16) / 10.0  # Minimum Humidity Hour

    Pa = int(Data[120:124], 16) / 10.0  # Barometric data

    Pa_1h_max = int(Data[130:134], 16) / 10.0  # Maximum air pressure hourly

    Pa_1h_min = int(Data[150:154], 16) / 10.0  # Minimum air pressure hour

    WindSpd = int(Data[140:144], 16) / 10.0  # Instantaneous wind speed

    WindSpd_10min_avg = int(Data[160:164], 16) / 10.0  # Average 10-minute wind speed

    WindSpd_max = int(Data[170:174], 16) / 10.0  # Maximum current wind speed

    WindSpd_min = int(Data[180:184], 16) / 10.0  # Current minimum wind speed

    WindDir = int(Data[190:194], 16) / 10.0  # Current Wind Direction Instantaneous Value

    WindDir_10min_avg = int(Data[200:204], 16) / 10.0  # 10-minute mean wind direction

    Rain_1day = int(Data[210:214], 16) / 10.0  # Daily rainfall

    # Estimating the Length of Latitude Data
    Lati_len = int(Data[220:224], 16)  # Conversion to 10-digit
    Lati = ""
    for i in range(2, Lati_len * 2, 2):
        Lati += (chr(int(Data[224 + (i - 2):224 + i], 16)))

    # Estimating Dimension Length and Data
    Long_len = int(Data[250:252], 16)
    Long = ""
    for i in range(2, Long_len * 2, 2):
        Long += (chr(int(Data[254 + (i - 2):254 + i], 16)))

    # Assemble data
    DataList = [Time, WindSpd, WindSpd_10min_avg, WindSpd_max, WindSpd_min, WindDir, WindDir_10min_avg,
                Temp, Temp_1h_max, Temp_1h_min, Hum, Hum_1h_max, Hum_1h_min, Pa, Pa_1h_max, Pa_1h_min, Rain_1day,
                Voltage]

    # Create a file path
    Path = "E:\\Fuoton\\data\\SY_FWS600\\"
    Text = os.path.join(Path, Time.strftime("%Y"), Time.strftime("%m")) + "\\" + Time.strftime("%d") + ".csv"
    FileDir = os.path.split(Text)[0]
    if not os.path.isdir(FileDir):
        os.makedirs(FileDir)
    # Write data
    with open(Text, "a+", newline="") as f:
        Writer = csv.writer(f)
        Writer.writerow(DataList)
    # Storage tips
    print(u"{}Time data has been successfully stored.".format(Time))

while True:
    try:
        Msg, ClientAddr = Server.recvfrom(1024)
        Data = binascii.b2a_hex(Msg)  # Converting data into hexadecimal data
        Data = str(Data, encoding="utf-8")
        print(u"from{0}Of{1}The port gets the following data:\n{2}".format(ClientAddr[0], ClientAddr[1], Data))
        if Data[0:2] == "7b":
            Content = "7B810010" + Data[8:30] + "7B"
            Response = binascii.a2b_hex(Content)
            Server.sendto(Response, ClientAddr)  # Reply to client data
            print(u"Replied Client")
        elif Data[0:2] == '01':
            DataParsing(Data)
        else:
            print(u"%%%%%%%%%%%%%%%Data Error Reporting and Retrieval%%%%%%%%%%%%%%%")
            continue
    except:
        print(u"%%%%%%%%%%%%%%%Data Error Reporting and Retrieval%%%%%%%%%%%%%%%")
        continue


Server.close()