Monthly Archives: August 2024

MapReduce: A 20-Year Retrospective on How Jeffrey Dean and Sanjay Ghemawat Revolutionised Data Processing

This article provides a retrospective on the 20th anniversary of Jeffrey Dean and Sanjay Ghemawat’s seminal paper, “MapReduce: Simplified Data Processing on Large Clusters”. It explores the paper’s lasting impact on data processing, its influence on the development of big data technologies like Hadoop, and its broader implications for industries ranging from digital advertising to healthcare. The article also looks ahead to future trends in data processing, including stream processing and AI, emphasising how MapReduce’s principles will continue to shape the future of distributed computing.

Continue reading

Celebrating a Milestone: Horkan.com Reaches 12th on Feedspot’s UK Tech Blog List

I’m pleased to share that Horkan.com has been recognised as the 12th most widely read tech blog from the UK by Feedspot, based on RSS feed aggregation in their recent article “Top 70 UK Tech RSS Feeds“. This acknowledgement is a significant moment for me, reflecting a journey that began over 17 years ago.

Continue reading

Revisiting the Cloud Security Initiative: Reflections on the Journey

In 2009, I spearheaded an initiative to establish a cloud security working group aimed at addressing the sovereignty and security of UK data within the cloud. The goal was to create a cross-sector collaboration involving both public and private entities, with the aim of ensuring that the UK maintained control over its critical data as cloud computing emerged as a pivotal part of the national infrastructure.

Continue reading

Revisiting the Home Office’s Big Data Initiative: A Success Story in Modernising Border Security

This article revisits the Home Office’s 2013 initiative to modernise border security using Big Data and Machine Learning. It highlights significant cost reductions, enhanced functionality through advanced data integration, and the strategic shift to open-source technologies, which improved security and flexibility. The piece also reflects on the challenges of avoiding vendor lock-in while strengthening UK border operations.

Continue reading

Revisiting the Cloud Computing Panel at Julie Meyer’s Entrepreneur Country: Reflections 15 Years On

This article revisits a 2009 cloud computing panel discussion at the ‘Entrepreneur Country’ event, hosted by Julie Meyer, examining how the ideas and predictions shared during the event have influenced the evolution of cloud computing over the past 15 years. It reflects on the entrepreneurial context of the time, the adoption and maturity of cloud services, legal and regulatory challenges, and the future vision for cloud technology, offering insights into the lessons learned and their relevance today.

Continue reading

Revisiting the Cloud Computing Model: A 15-Year Reflection

This new article revisits a conceptual framework of cloud computing I introduced in 2009, exploring how cloud roles, billing models, and security have evolved over the past 15 years. It discusses the maturity of cloud services, the expansion of “as-a-service” models, and the rise of country-specific cloud solutions. The piece also highlights potential disadvantages such as hidden costs, vendor lock-in, and the recent trend of companies moving away from cloud providers. The article concludes with predictions of cloud computing.

Continue reading

Optimising SQL in Ruby on Rails with PostgreSQL: Best Practices and Strategies

This article explores strategies for optimising SQL performance in Ruby on Rails applications using PostgreSQL. It covers techniques such as avoiding N+1 queries, efficient indexing, leveraging PostgreSQL-specific features, and monitoring performance to ensure applications remain efficient and scalable.

Continue reading

Practical Strategies for Optimising SQL: Refactoring, Indexing, and ORM Best Practices

This article provides practical strategies for optimising SQL performance, covering query refactoring, index usage, and ORM best practices. It offers developers actionable tips to improve the efficiency and scalability of their applications.

Continue reading

Leveraging Sequence Diagrams for SQL Optimisation: A Non-Functional Perspective

This article explores how extending sequence diagrams to include non-functional aspects can help developers better understand and optimise SQL performance by highlighting often-overlooked details like database hits and data transfer volumes.

Continue reading

Bridging the Divide: Understanding Application Development vs. Database Optimisation

This article explores the divide between application developers and database administrators, highlighting how their differing focuses can lead to inefficiencies in SQL performance. It discusses the importance of bridging this gap by encouraging collaboration and a unified approach to optimise both application logic and database performance.

Continue reading