https://xeraa.net/tags/cap/Software development, operations, community, and moreen-usMon, 14 Oct 2019 00:00:00 +0000https://xeraa.net/talks/make-your-data-fabulous/Mon, 14 Oct 2019 00:00:00 +0000Philipp Krennhttps://xeraa.net/talks/make-your-data-fabulous/<p>The CAP theorem is widely known for distributed systems, but it&rsquo;s not the only tradeoff you should be aware of. For datastores there is also the FAB theory and just like with the CAP theorem you can only pick two:</p> <ul> <li>Fast: Results are real-time or near real-time instead of batch oriented.</li> <li>Accurate: Answers are exact and don&rsquo;t have a margin of error.</li> <li>Big: You require horizontal scaling and need to distribute your data.</li> </ul> <p>While Fast and Big are relatively easy to understand, Accurate is a bit harder to picture. This talk shows some concrete examples of accuracy tradeoffs Elasticsearch can take for terms aggregations, cardinality aggregations with HyperLogLog++, and the IDF part of full-text search. Or how to <strong>trade some speed or the distribution for more accuracy</strong>.</p> <p><div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"> <iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube-nocookie.com/embed/G0XGv8GrhMk?autoplay=0&amp;controls=1&amp;end=0&amp;loop=0&amp;mute=0&amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"></iframe> </div> <!-- https://www.youtube.com/watch?v=G0XGv8GrhMk --></p>