Collection artifact, Octopus Automatic Grab strategy and warehousing operation!

Collect a lot of anti - Crawler sites, there is a very good tool: Octopus... Directly through the browser access, a force to break ten thousand methods Preparatory work: money, spend money to buy members of Octopus website for a month or more, so that you can do Cloud Collection Next, grab the data by yourself. After the grab, set the timing ...

Posted by christillis on Tue, 02 Jun 2020 17:02:35 +0200

Adaptive page arrangement of a bunch of pictures

Recently, we are developing a page to display pictures in batches. The adaptive arrangement of pictures is an unavoidable problem After paying for a lot of hair, I finally finished the picture arrangement and encapsulated it into components. The final effect is as follows     1, Design ideas In order to make the structure clear, I process the ...

Posted by coreycollins on Mon, 01 Jun 2020 05:48:42 +0200

golang API request queue

outline Realization ideas usage method Start queue service Use queue service outline When a third-party API is called, there are basically restrictions on the access speed limit. When there are multiple third-party APIs, it is not good to control the access speed, which often leads to HTTP 429(Too Many Requests) and then it will be banne ...

Posted by SauloA on Sun, 31 May 2020 10:17:47 +0200

Developing dynamic forms from 0 to 1

Tree sauce hope to bring the fun of the front end to you this article has been included github.com/littleTreem... Like star A kind of Cutting edge: there are a lot of forms in the application of the middle and background. The left hand is a form, and the right hand is a form. There is no end to it. If you use templates to write one b ...

Posted by BSlepkov on Fri, 29 May 2020 06:52:42 +0200

Implementation of chat tool based on Serverless and Websocket

It is not difficult for traditional business to implement Websocket. However, function calculation is basically event driven and does not support long link operation. If the function calculation is combined with the API gateway, can there be a Websocket implementation scheme? Implementation of Websocket with API gateway trigger WebSocket pro ...

Posted by markepic on Wed, 27 May 2020 09:47:32 +0200

Web service deployment deep learning model - Zhihu

The purpose of this article is to introduce how to use Web services to deploy deep learning model quickly. Although TF has TFserving to deploy the model, it can't do anything for python (if you want to use it, you need to transform the torch model, which is a bit troublesome); therefore, this article introduces a method of using Web services ...

Posted by urb on Wed, 27 May 2020 07:12:58 +0200

How do I use Lock? What is the difference between Lock and synchronized?

  Lock   It's like a synchronization block, java.util.concurrent.locks.Lock Is the thread synchronization mechanism. However, locks are more flexible and complex than synchronous blocks. Because lock is an interface, you need to use one of its implementations to use lock in your application. ReentrantLock is one such implementation of ...

Posted by greedyisg00d on Wed, 27 May 2020 07:09:42 +0200

zabbix alarm information pushed to kafka

Application scenario Due to the high security requirements of the company where the friend is located, zabbix's network environment cannot be connected to the Internet, so it is not possible to send the alarm directly to some instant messaging tools through zabbix, which requires sending the alarm message to some middleware and forwarding it t ...

Posted by lanas on Tue, 26 May 2020 19:11:42 +0200

BeanMap transforms objects to maps

There are many ways to convert JavaBeans and map s, such as: Through ObjectMapper, bean s are first converted to json, and then json is converted to map. However, this method is relatively cumbersome and inefficient test , it takes 12 seconds to cycle through 10000 bean s!!! Not recommended adopt Java Reflection, get the properties and ...

Posted by sysgenmedia on Sat, 23 May 2020 16:34:30 +0200

SpringCloud exception handling unified encapsulation for me to do-use

brief introduction Repeat function for me to write.There are global exception handling and return wrapping in the SpringBoot project, and the return front end is with fields such as succ, code, msg, data, and so on.Single project scenario is a good solution, when there are many micro-service modules, many cases of development are to copy the or ...

Posted by iijb on Sat, 23 May 2020 05:57:28 +0200