Designing a platform for Tweet Collection, Analytics and Storage (TweetCASP)

Authors : Tugba Beril Doguc, Ahmet Arif Aydin

Pages : 165-171

Doi:10.53070/bbd.1344271

View : 39 | Download : 45

Publication Date : 2023-10-18

Article Type : Research

Abstract :In this era of big data, the streaming, storage, and analysis of large amounts of data present a variety of challenges. Several challenges must be addressed by designers of data-intensive systems in order to retrieve useful information. Collecting, storing, and analyzing data requires a collection and analytics platform comprised of an appropriate choice of data processing and analytics technologies in order to acquire meaningful insight. In this paper, we report on TweetCASP (Tweet Collection, Analytics and Storage Platfrom), which gathers tweets based on user-entered keywords using Twitter\'s Streaming API, providing an environment for real-time analytics on streaming data and permanently storing data in an Apache Cassandra NoSQL datastore to fulfill future batch-oriented data processing requirements. Moreover, The TweetCASP presents an example of a data-intensive system used by software developers, designers, and researchers for data collecting and analytics.
Keywords : Büyük veri, veri yoğunluklu sistemler, gerçek zamanlı analiz, akış analitiği, NoSQL.