[Python3 Crawler] Crawl records of JS-encrypted data at once

1. Preface This is a record of cracking JS encrypted data on a website at: https://www.qimingpian.cn/finosda/event/einvestment To get the investment event information on this page, you can first confirm that the data is transmitted through AJax, not written directly in the source code of the web page.   2. Steps 1. Grab a bag Open the develop ...

Posted by k4pil on Thu, 16 Jan 2020 03:39:27 +0100

Node sass generates source map / listening file

Node sass generates source map / listening file 0. Irrelevant (can be skipped) Problems encountered - > > I don't know how to use node sass to generate the source map file. It can be generated directly in my local ruby environment But now the project is to change all the saas files compiled in ruby to node sass. The ...

Posted by Invincible on Fri, 03 Jan 2020 20:25:54 +0100

Configure redisCluster cluster

1. Install Redis image docker pull yyyyttttwwww/redis 2. Create net2 network segment docker network create --subnet=172.19.0.0/16 net2 3 create a node Redis container #Rename the redis image: docker tag docker.io/yyyyttttwwww/redis redis #Delete old redis docker rmi docker.io/yyyyttttwwww/redis #Create 6 redis containe ...

Posted by shana on Sat, 14 Dec 2019 19:18:14 +0100

Effectively use Git and Dropbox at the same time?

How to use them together effectively Git and Dropbox ? #1 building I ran into a similar problem and created a small script for it. The idea is to use Dropbox with Git as simply as possible. At present, I have realized it quickly Ruby Code, and I'll add more code soon. The script is available at https://github.com/nuttylabs/box-git. ...

Posted by Hitoshi on Wed, 11 Dec 2019 19:35:10 +0100

Several ways to export and import redis data

Several ways to export and import redis data 1 environmental description: 192.168.1.101 node1 redis source instance 192.168.1.102 node2 redis target instance 192.168.1.103 node3 any linux system 2 redis dump mode 2.1 installation of RVM Redis dump needs to use ruby, and the maximum version of ruby that can be installed in centos environment ...

Posted by eddie_twoFingers on Thu, 05 Dec 2019 07:02:06 +0100

Redis Cluster Deployment and Principle

1. Redis Cluster Architecture Details: 1. All Redis nodes are interconnected with each other (PING-PONG mechanism). Binary protocol is used to prioritize transmission speed and bandwidth. 2. Node failure will take effect only when more than half of the master nodes in the cluster fail to detect. 3. Clie ...

Posted by thomasd1 on Mon, 23 Sep 2019 07:51:42 +0200

Step by Step! Kubernetes Continuous Deployment Guide

This paper is the Kubernetes continuous deployment workflow, which is summarized step by step from zero basis through the author's own practice. The article begins with the preparation of tools in the early stage, and then proceeds to the final deployment of repository, testing, mirror building, pipeline building. All the work processes are sho ...

Posted by Errant_Shadow on Thu, 05 Sep 2019 09:12:12 +0200

Distributed Construction of redis cluster Single Machine Pseudo-3 Master-3 Slave-3 Sentinel Cluster

Recently, the company introduced a micro-service framework, the previous redis 60G storage has been unable to meet the current 260G business needs, after some consideration to build the cluster. In order to facilitate my demonstration with a server, production environment is not recommended to do so (useless), just to record the process, as f ...

Posted by dtyson2000 on Mon, 12 Aug 2019 12:20:54 +0200

List of items for Python fun games

Python programming is a quick way to practice project topics. Welcome to identify and optimize!You're creating a fun video game. The data structure used to model the player's inventory is a word.Dian. The key is a string describing the item in the list. The value is an integer value indicating how many items the player has.Product. For example ...

Posted by liljester on Wed, 31 Jul 2019 20:42:45 +0200

Use of sed and awk under linux

Article Directory sed: awk sed: Common options: -n: Use silent mode.In general sed usage, all data from STDIN is typically listed on the screen.However, if the -n parameter is added, only the line (or action) that has been specifically treated by sed will be listed. -e: edit sed actions directly ...

Posted by rantsh on Mon, 29 Jul 2019 03:07:32 +0200