WAL persistents operation to disk, then write to cache. If each operation needs to persistent to disk, then it is low efficient. Instead, do batching, this helps to improve performance, also reduce the error to batch level. https://martinfowler.com/articles/patterns-of-distributed-systems/wal.html Flushing every log write to the disk gives a strong durability guarantee (which is the main purpose… Read More »
rigidity code, modules are coupled. Change in module1, requires change module2, then requires change in module3. fragile code, change in module1, but it caused issue in other module or system, which is very unrelated to the module1. Bazzare break, weird break. Like your car window can’t be opened, mechanics fixed the window, but the car… Read More »
Different windows Tumbling Windows, fixed window. BI analysis. Only cares about the result within a certain time. Sliding Window, 有步长，数据可能会重复使用。场景，需要实时分析，给出结果。如股票交易，最近一段时间的交易情况. Session Window, if long time haven’t received event, then it comes a new window. It’s like timeout. https://www.youtube.com/watch?v=MSp_w5dnhF4 Watermark, TimestampExtractor etc. Flink Watermark, watermark can be treated as a special event. Every event which the… Read More »
Sometimes, when develop a feature branch, then, we merge back to master branch. This results a ring. This made the merge point has 2 parents. So tracing back the diff would be difficult. The scenario we allow the ring and merge point is that the feature branch is kinda big feature. In the branch, it… Read More »
Start a docker container with below Dockerfile. Since it has CMD [“nginx”]. The docker container exists after nginx command is finished. It couldn’t be connected even with –detach mode. In order to keep the docker container running, needs the CMD run in foreground. Let it keep running. So it needs a “daemon off” in nginx.conf… Read More »
Install docker on mac: brew install docker Download docker.dmg and install Run jenkins in background docker run -d -p 8080:8080 -p 50000:50000 jenkins // 8080:80, host port 8080, container port 80 -d makes it to run background. Just like nohup Run centos in docker docker run -it centos /bin/bash -it makes it run interactive mode,… Read More »
jenkins start/stop https://www.jenkins.io/download/lts/macos/ Create Jenkins pipeline with Freestyle project
If one connection supports 5TP, then 5 connection supports 25TPS. In another word, if a connection supports 5TPS, that means request latency is 200ms. We have: TPS = number_of_connection / request_latency So TPS relates to TPS per connection and number of connection. How to find max TPS? set connection to 1, literally increase TPS from… Read More »
Below is the read-after-write model: GET /key-prefix/cool-file.jpg 404 PUT /key-prefix/cool-file.jpg 200 GET /key-prefix/cool-file.jpg 200 As we can see, file doesn’t exist at beginning. As long as PUT is done, GET always return successfully. Below is eventually consistency model: GET /key-prefix/cool-file.jpg 404 PUT /key-prefix/cool-file.jpg 200 GET /key-prefix/cool-file.jpg 404 File doesn’t exist, after PUT is done, GET… Read More »
Instead of interact with direct resource, client interacts with proxy, then proxy interacts with real resources. Reasons could be: cache, security, encapsulation(http). A proxy has same interface as the original class. In this case, the proxy has same behavior as original class. Adaptor changes the interface. Facade enhances the interface. In below graph: RealSubject implements… Read More »