[Python3 Crawler] Crawl records of JS-encrypted data at once
1. Preface
This is a record of cracking JS encrypted data on a website at:
https://www.qimingpian.cn/finosda/event/einvestment
To get the investment event information on this page, you can first confirm that the data is transmitted through AJax, not written directly in the source code of the web page.
2. Steps
1. Grab a bag
Open the develop ...
Posted by k4pil on Thu, 16 Jan 2020 03:39:27 +0100
Node sass generates source map / listening file
Node sass generates source map / listening file
0. Irrelevant (can be skipped)
Problems encountered - > >
I don't know how to use node sass to generate the source map file. It can be generated directly in my local ruby environment
But now the project is to change all the saas files compiled in ruby to node sass. The ...
Posted by Invincible on Fri, 03 Jan 2020 20:25:54 +0100
Configure redisCluster cluster
1. Install Redis image
docker pull yyyyttttwwww/redis
2. Create net2 network segment
docker network create --subnet=172.19.0.0/16 net2
3 create a node Redis container
#Rename the redis image:
docker tag docker.io/yyyyttttwwww/redis redis
#Delete old redis
docker rmi docker.io/yyyyttttwwww/redis
#Create 6 redis containe ...
Posted by shana on Sat, 14 Dec 2019 19:18:14 +0100
Effectively use Git and Dropbox at the same time?
How to use them together effectively Git and Dropbox ?
#1 building
I ran into a similar problem and created a small script for it. The idea is to use Dropbox with Git as simply as possible. At present, I have realized it quickly Ruby Code, and I'll add more code soon.
The script is available at https://github.com/nuttylabs/box-git.
...
Posted by Hitoshi on Wed, 11 Dec 2019 19:35:10 +0100
Several ways to export and import redis data
Several ways to export and import redis data
1 environmental description:
192.168.1.101 node1 redis source instance
192.168.1.102 node2 redis target instance
192.168.1.103 node3 any linux system
2 redis dump mode
2.1 installation of RVM
Redis dump needs to use ruby, and the maximum version of ruby that can be installed in centos environment ...
Posted by eddie_twoFingers on Thu, 05 Dec 2019 07:02:06 +0100
Redis Cluster Deployment and Principle
1. Redis Cluster Architecture Details:
1. All Redis nodes are interconnected with each other (PING-PONG mechanism). Binary protocol is used to prioritize transmission speed and bandwidth.
2. Node failure will take effect only when more than half of the master nodes in the cluster fail to detect.
3. Clie ...
Posted by thomasd1 on Mon, 23 Sep 2019 07:51:42 +0200
Step by Step! Kubernetes Continuous Deployment Guide
This paper is the Kubernetes continuous deployment workflow, which is summarized step by step from zero basis through the author's own practice. The article begins with the preparation of tools in the early stage, and then proceeds to the final deployment of repository, testing, mirror building, pipeline building. All the work processes are sho ...
Posted by Errant_Shadow on Thu, 05 Sep 2019 09:12:12 +0200
Distributed Construction of redis cluster Single Machine Pseudo-3 Master-3 Slave-3 Sentinel Cluster
Recently, the company introduced a micro-service framework, the previous redis 60G storage has been unable to meet the current 260G business needs, after some consideration to build the cluster. In order to facilitate my demonstration with a server, production environment is not recommended to do so (useless), just to record the process, as f ...
Posted by dtyson2000 on Mon, 12 Aug 2019 12:20:54 +0200
List of items for Python fun games
Python programming is a quick way to practice project topics. Welcome to identify and optimize!You're creating a fun video game. The data structure used to model the player's inventory is a word.Dian. The key is a string describing the item in the list. The value is an integer value indicating how many items the player has.Product. For example ...
Posted by liljester on Wed, 31 Jul 2019 20:42:45 +0200
Use of sed and awk under linux
Article Directory
sed:
awk
sed:
Common options:
-n: Use silent mode.In general sed usage, all data from STDIN is typically listed on the screen.However, if the -n parameter is added, only the line (or action) that has been specifically treated by sed will be listed.
-e: edit sed actions directly ...
Posted by rantsh on Mon, 29 Jul 2019 03:07:32 +0200