About Apache Pulsar

Apache Pulsar yes Apache Software foundation top projects , It is the next generation cloud native distributed message flow platform , Set message 、 Storage 、 The lightweight function formula is calculated as a rest , Using the separation of computing and storage architecture design , Multi tenant support 、 Persistent debt deposit 、 Multi machine room cross regional data replication , With strong consistency 、 High throughput 、 Low latency and high scalability streaming data storage features .
GitHub Address : http://github.com/apache/pulsar/

This afternoon, , from Apache Pulsar Formed by founding members StreamNative The team will work with Tencent cloud middleware to jointly organize the new phase  Apache Pulsar Meetup. Limited to epidemic situation , In this issue Meetup Will be launched online , The event invited people from vivo、 Tencent cloud 、BIGO、 Yunxing technology and other team engineers and Apache Pulsar Committer/Contributor Share together Apache Pulsar Landing practice in different scenarios .

Schedule of activities

Details of the issue

Apache Pulsar stay vivo Exploration and practice of

Benefit the people

vivo Internet Big Data Engineer , He is currently responsible vivo Construction of distributed message middleware

Share summary ：vivo Mobile Internet is designed for 3.5 Billion worldwide vivo Smart phone users provide the ultimate Internet products and services . At present, a complete mobile Internet ecosystem has been established , around vivo Big data operations , Building includes applications 、 game 、 information 、 brand 、 Online retailers 、 Content 、 A full-service ecosystem including finance and search .

In the past few years , We use multiple Kafka Clusters support trillions / Days of data ETL、 recommend 、Push、 Monitoring and other Internet businesses . Now we choose to use Apache Pulsar As our next generation of message oriented middleware to meet the challenges of higher-level data .

In this speech , We will share our choices Pulsar The reason of , as well as vivo stay Pulsar Cluster management 、 performance tuning 、 Practical experience in monitoring .

Apache Pulsar In Tencent Cloud Stability Optimization Practice

Share summary ：Apache Pulsar Large scale production practice has been achieved in Tencent cloud . In the past year , It has undertaken different usage scenarios in many industry ecosystems . In actual production practice , We have done a series of work on performance optimization and stability functions for the community version , To ensure the stable and efficient operation of the system in different scenarios . This sharing will focus on Tencent cloud in the past year Pulsar The optimization of stability and performance is carried out .

BIGO be based on Pulsar Performance Optimization Practice in high throughput catch-up reading scenario

BIGO Staff Engineer, BIGO Senior big data R & D Engineer of computing platform , At present, his main focus is on the calculation and storage of streaming systems . He was also Apache Pulsar、Pulsar-Flink Connector Contributor、Kafka-on-Pulsar Maintainer, I have been invited to Pulsar Meetup、Pulsar Summit Give a technical speech on .

Share summary ：BIGO At present, there are BIGO Live and Likee Short video two major video products and services , At present BIGO Live Live broadcast service has been covered 150 Many countries and regions ,Likee Short videos also have more than 1 Billion users , Products in the Z It's very popular in generations . In the past technology architecture ,BIGO Open source Kafka Cluster to support real-time data analysis and short video recommendation services . But as the business continues to grow rapidly , The architecture of the past has met with great challenges .Apache Pulsar Bring layered architecture and low latency 、 Persistent storage 、 The features of easy expansion and so on help us solve many problems faced in the production system .

This speech will introduce BIGO be based on Pulsar In a high throughput read-write environment 、 Performance optimization for catch-up reading scenarios , The main content of this article includes ： Catch up reading on the discussion of system performance loss 、 The main time-consuming stage of message disk reading 、BIGO Proposed a new asynchronous read ahead optimization scheme 、 The actual performance effect of the new strategy in the production environment . This sharing will be the most practical way to share with you BIGO Thoughts and experiences when optimizing the catch-up reading scene .

Pulsar Functions Practice in smart city

Liang Yuanpeng

Share summary ：Pulsar Functions As in MQ Of the scene FaaS Concept practitioner , It is naturally suitable for event driven IOT scenarios , Will be Apache Pulsar After the message queue , Use Pulsar Functions It can be said that it is a matter of following the trend . At present Apache Pulsar It has performed well in large-scale or even super large-scale scenes , In this sharing , Let's take a look at the Internet of things ,Apache Pulsar In hundreds of thousands Topic Practice in the edge device scenario , Also tell Pulsar Functions How to provide flexible data flow processing capabilities for enterprises .

Thank you, partner

This activity has received strong support from many communities and partners , Special thanks to the co sponsors Tencent cloud middleware and CSDN 、SegmentFault Think no 、vivo Internet technology and open source are signing up for the event 、 Strong support from live broadcast and other aspects ！

The organizers ：StreamNative x Tencent cloud intermediate  
Strategic cooperation community ：CSDN、SegmentFault Think no  
live broadcast / Promotion partners ： Kaiyuan society 、vivo Internet technology

Event registration

Click on 「 Read the original 」 Or scan the QR code below to sign up ：

sweep / code / newspaper / name