{"id":470,"date":"2015-06-15T07:10:05","date_gmt":"2015-06-15T07:10:05","guid":{"rendered":"http:\/\/www.angani.co\/blog\/?p=517"},"modified":"2023-12-18T11:26:57","modified_gmt":"2023-12-18T11:26:57","slug":"its-not-how-much-fibre-you-have-its-what-you-do-with-it","status":"publish","type":"post","link":"https:\/\/angani.africa\/blog\/its-not-how-much-fibre-you-have-its-what-you-do-with-it\/","title":{"rendered":"It\u2019s Not How Much Fibre You Have, It\u2019s What You Do With It"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"attachment-full wp-post-image\" src=\"http:\/\/web.archive.org\/web\/20150824200558im_\/https:\/\/angani.co\/blog\/wp-content\/uploads\/2015\/06\/blog-post-dw-response.jpg\" alt=\"blog-post-dw-response\" width=\"716\" height=\"426\" \/><\/p>\n<p>David Weekly highlights the issue of high Internet access latency in emerging markets in his interesting and topical (for us!) Facebook <a href=\"http:\/\/web.archive.org\/web\/20150824200558\/https:\/\/www.facebook.com\/dweekly\/posts\/10101729307500703\">post<\/a>. \u00a0We are glad that David\u2019s post managed to generate much discussion all round. This is the core reason we started Angani \u2013 to provide a robust, scalable and more importantly a local environment to host data on the continent.<\/p>\n<p>Africa as a continent accounts for only 3% of all Internet traffic in the world. As a result, it remains out of everyone\u2019s mind when it comes to getting their content closer to their users. This results in poor user experiences, and more so much higher costs of bandwidth, since all traffic has to traverse expensive transit and submarine links to reach datacenters in Europe or the US.<\/p>\n<p>In David\u2019s article, he advocates the use of edge caching as a technical lever for mitigating the access latency problem. While we agree with his position we believe a broader treatment is required to effectively tackle the problem at a continental scale.<\/p>\n<p><b>Latency<\/b><\/p>\n<p>To begin with, it\u2019s important to point out that we\u2019re in a \u201cGolden age\u201d of latency. Just 5 years ago it was typical that the \u201cbest case\u201d round-trip latency experienced on satellite links was in the order of 700ms, so by that respect 150ms is <i>excellent.<\/i> \u00a0Nevertheless, given that the human eye requires 150-200ms to<a href=\"http:\/\/web.archive.org\/web\/20150824200558\/http:\/\/www.jneurosci.org\/content\/26\/15\/3981.full\">register<\/a> something on the screen you will agree 150ms is still quite high.<\/p>\n<p>Furthermore, 150ms is, unfortunately, \u00a0typically the best-case round-trip latency you\u2019ll experience. Given the large physical distance between Africa and the rest of the world physical propagation delay (5ns per metre) quickly begins to affect latency, not to mention the buffering and network congestion issues prevalent at the network layer. Coupled with this, poor peering arrangements between Africa and the rest of the world further exacerbate the latency problem.<\/p>\n<p><a href=\"http:\/\/web.archive.org\/web\/20150824200558\/https:\/\/angani.co\/blog\/wp-content\/uploads\/2015\/06\/blog-post-dw-response.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\" size-full wp-image-539 aligncenter\" src=\"http:\/\/web.archive.org\/web\/20150824200558im_\/https:\/\/angani.co\/blog\/wp-content\/uploads\/2015\/06\/blog-post-dw-response.jpg\" alt=\"blog-post-dw-response\" width=\"716\" height=\"426\" \/><\/a><\/p>\n<p>In practice, we\u2019ve found, in East Africa at least, latency is the single biggest chokehold preventing SMEs adopting and effectively using the cloud for their real-time applications such as ERPs. \u00a0[Fig1] shows you how bad it is, providing round-trip times from our data centre in Nairobi to various endpoints in the world as collected in Q1 2014. Of particular interest is the fact that the latency to anything that isn\u2019t in Europe or the USA is exceedingly high.<\/p>\n<p>While users on the continent continue to benefit from technical optimizations designed to reduce latency in the common case (e.g. TCP Fast Open, HTTP keep-alive, QUIC etc), it is clear overcoming the latency problem is an important step to realizing wide-scale and prevalent cloud adoption in the region. \u00a0It should therefore come as no surprise to you that latency reduction is one of the major tenets on which we started Angani. We\u2019re <i>all<\/i> about <a href=\"http:\/\/web.archive.org\/web\/20150824200558\/https:\/\/angani.co\/blog\/wp-content\/uploads\/2015\/06\/ang.pdf\" target=\"_blank\" rel=\"noopener\">reducing latency<\/a> as the first 10G open commercial platform in the region and we\u2019ve put a lot of effort and time into making sure we can turn around a packet in &lt; 100us on our network. We have done all this <i>because<\/i> we strongly believe that providing a local, low access-latency platform on which SMEs, start-ups and large incumbents can host, deploy and use cloud based applications is an essential component to making Kenya a cloud first and first-class cloud country!<\/p>\n<p><b>Bandwidth Costs<\/b><\/p>\n<p>In effect, when accessing content that\u2019s in-country, you are only paying for last mile connectivity (fiber or 3G), whereas accessing content out-of-country means your ISP has to pay the cost of the submarine cable, long-distance fiber and IP Transit costs necessary to connect your machine to the datacenter you\u2019re accessing.<\/p>\n<p>These costs add up to constitute the per Megabit bandwidth cost that operators bear and charge their customers. A 1Gb port at the local Exchange Point \u2013 KIXP costs $350, so per megabit cost for local in-country content stands at $0.35, compared to international submarine cable access which costs $200 per megabit. Just think about that again \u2013 $0.35 vs $200.<\/p>\n<p>This is the core reason why localization of content is important. Google has rolled out Google Global Caches (GGC) in most African countries. This has resulted in operators saving up to 30% of their bandwidth costs, because now traffic to YouTube doesn\u2019t have to travel through expensive international links to datacenters in Europe. Akamai \u2013 a global CDN provider \u2013 also setup a node in Kenya a couple of years ago (after being begged to do so for over 10 years!). This realized an additional 15-20% savings for the ISPs.<\/p>\n<p>As a result of the better user experience (everything loads much faster at 10ms) \u2013 Akamai and Google both saw massive increase in traffic served out of their caches. This is clearly captured, for example, in this<a href=\"http:\/\/web.archive.org\/web\/20150824200558\/http:\/\/www.internetsociety.org\/news\/local-internet-hosting-opportunities-key-furthering-internet-development-emerging-economies\">ISOC report<\/a>. \u00a0Savings in bandwidth costs and a reduction in latency ultimately lead to increased user uptake. From our personal experience, within just 6 months of setting up a local edge caching node, a content provider typically sees a 5x-7x increase in traffic. This traffic goes on to increase 100% year on year.<\/p>\n<p>While we know there is no simple solution \u2013 the fact that localization of content provides a 50% cost savings on bandwidth, and 7x increase in traffic within a year \u2013 does signal it should be a pretty high priority for all content providers and African operators !<\/p>\n<p><b>Technical Challenges<\/b><\/p>\n<p>Going back to David\u2019s post, edge caching, in particular, while useful for static content hosted which is generally consumed (e.g. video) does not help with most Cloud applications. Cloud applications largely require two-way sending and receiving of data, so if we are to see more businesses being able to run interactive applications on the Cloud, more local POPs are required which carry the full application stack. For example, while your Google Photos viewing may be cached, for someone to upload the photos \u2013 you still have to upload them to a datacenter in Europe. In David Weekly\u2019s tests \u2013 Google and Apple content is actually served off a local edge cache in Nairobi, however that does not serve DNS traffic for example from Google\u2019s famous 8.8.8.8 IP address which is interactive (send-receive). Another tricky problem is if people use 8.8.8.8 \u2013 a CDN provider such as Akamai will see your request as coming from Europe, and will serve the request out of a European datacenter as opposed to the node in Nairobi.<br \/>\nThe second technical challenge lies with the implementation of peering relationships, and the technical setup of the same. Not all ISPs in Kenya are using the Akamai node for example. Some ISPs still do not realize the full value of the GGC and have refused to participate in peering with the GGC node. As a result, these ISPs are yet to experience the cost-savings and their customers are unable to see a better user experience.<\/p>\n<p>Additionally, some content providers may get into agreements for edge caching with the wrong operators. The Internet industry in Kenya has always developed largely due to friendly and open peering policies at the KIXP. However, as the ecosystem has grown, the industry has seen some operators like SEACOM take a different stance on Peering, choosing not to peer openly, but instead opting for Paid peering models. This helps in getting an Edge Cache deployed closer to users in Nairobi, but it doesn\u2019t result in any bandwidth savings for the other ISPs since they still have to pay a Transit-level cost to access that content (it\u2019s not freely available at the KIXP). It remains to be seen how this will go on to affect the industry as a whole, once peering policies change in the region from the previous open policies.<\/p>\n<p><b>In Conclusion \u2026<\/b><\/p>\n<p>We believe that Africa\u2019s internet evolution story will be no different from the rest of the world. We listen to music. We watch movies. We play games online. The same considerations that go into offering internet services in Europe, the US etc apply in Africa. Zuku, with it\u2019s triple play service, proved that there is a demand for high bandwidth links along with bundled entertainment services. IT administrators in Kenya deal with the same issues IT administrators in the US deal with. We have 4G networks, iPhones, the latest Android phones. It\u2019s really the same evolution. So for the continent to change, what we really need is more intra africa fiber that is both affordable and reliable. The hosting infrastructure will be developed around this (as Angani is doing). At Angani, we believe that we are playing our role in bringing down the cost of Internet access by ensuring that we will have a node in every country in Africa that will provide low latency affordable and most importantly reliable hosting infrastructure for the continent. Let\u2019s bring our content back onto the continent.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>David Weekly highlights the issue of high Internet access latency in emerging markets in his interesting and topical (for us!) Facebook post.  We are glad that David\u2019s post managed to generate much discussion all round. This is the core reason we started Angani \u2013 to<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[133],"tags":[],"class_list":["post-470","post","type-post","status-publish","format-standard","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/posts\/470","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/comments?post=470"}],"version-history":[{"count":1,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/posts\/470\/revisions"}],"predecessor-version":[{"id":6258,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/posts\/470\/revisions\/6258"}],"wp:attachment":[{"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/media?parent=470"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/categories?post=470"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/angani.africa\/blog\/wp-json\/wp\/v2\/tags?post=470"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}