In June 1948, three British rubber planters were shot dead at their estates near Sungai Siput, a small town in the Malayan state of Perak. Within forty-eight hours, the imperial administration in Kuala Lumpur declared a state of emergency. What followed was a twelve-year campaign that the official vocabulary refused to call a war, partly because the rubber and tin companies that dominated the peninsula could not have renewed their insurance policies against a conflict. The methods Britain refined to win that campaign, namely intelligence-led targeting, deep informant networks, the systematic separation of fighters from the civilian population, and the patient destruction of an insurgent leadership, became a template studied and copied by security services across the decolonizing world. One of those services belonged to the country Britain had ruled for ninety years and had relinquished just ten months before the Malayan guns opened fire.

That country was India. When the Union Jack came down over Delhi in August 1947, the new republic did not build its intelligence apparatus from a blank sheet. It inherited one. The Intelligence Bureau that the independent Indian state took possession of was the same organization the Raj had used to watch, infiltrate, and disrupt the very independence movement that had just triumphed. The officers who staffed it had trained under British supervisors. The filing systems, the surveillance doctrines, the legal instruments of preventive detention, and the political policing model known across the empire as the Special Branch all carried over intact. India did not so much create an intelligence service as take delivery of one.

This is the uncomfortable lineage that connects a planters’ murder in Perak to the targeted eliminations that define India’s shadow war today. The campaigns Britain fought in Malaya, in Kenya, in Aden, in Cyprus, and across a dissolving empire were laboratories of covert practice. They produced doctrine. They produced personnel. They produced a way of thinking about insurgency that treated intelligence as the decisive weapon and the population as the contested terrain. And when the empire withdrew, it left that doctrine behind in the institutions it had built. To understand where India’s intelligence culture came from, and why the country’s covert operations carry a particular institutional accent, the trail runs back through the colonial shadow wars and the secret services that fought them.

Background and Triggers

The Secret Intelligence Service, known to the public as MI6, was founded in 1909 as the foreign section of a Secret Service Bureau split between domestic and overseas work. Its early decades were consumed by European rivalries, the two world wars, and the long contest with Soviet intelligence. Yet the empire was never a marginal concern. For most of the twentieth century, a large share of Britain’s secret activity was directed not at great-power adversaries but at the management of colonial populations and the suppression of nationalist movements within territories London claimed to govern.

The institutional picture was more tangled than the single name MI6 suggests. Colonial security was a collaboration. The Security Service, MI5, held responsibility for counter-subversion across the empire and ran a network of Security Liaison Officers posted to colonial capitals. The Secret Intelligence Service handled the genuinely foreign dimension, the watching of neighbouring states and the running of agents beyond British-controlled borders. Colonial police forces, and within them the political units known almost everywhere as Special Branch, did the daily work of surveillance and informant management on the ground. Military intelligence staffs handled the campaigns. And in London, a small and now largely forgotten organization called Indian Political Intelligence spent decades tracking Indian revolutionaries and exiles across Europe and the Americas. The imperial intelligence machine was therefore not one agency but a federation of them, knitted together by shared doctrine, shared personnel, and a shared assumption that the security of empire justified almost any method.

It is worth dwelling on how this machine evolved, because its development explains the depth of the doctrine it eventually transmitted. Britain’s secret work overseas was, for most of the nineteenth century, an improvised affair conducted by soldiers, diplomats, and the political officers of the frontier. The professionalization came in stages. The creation of a dedicated Secret Service Bureau in 1909, soon divided into a home section and a foreign section, gave Britain for the first time a permanent institutional home for espionage and counter-espionage. The two world wars expanded both branches enormously, drew in a generation of talented amateurs, and forced the development of disciplined tradecraft in agent handling, deception, and signals work. By 1945 Britain possessed a mature secret service tradition, and it brought that tradition to bear on the problem that now dominated its agenda, which was the survival of an empire under nationalist assault.

What gave the colonial dimension of this work its particular character was the fusion of policing and espionage. In a sovereign foreign country, a secret service runs agents against a government it does not control. In a colony, the same service operated inside a territory its own state administered, alongside a police force its own state commanded. The result was a hybrid: an intelligence practice that combined the agent-running tradecraft of espionage with the arrest powers, the informant networks, and the legal authority of a police force. That hybrid was institutionalized in the Special Branch, the political wing of the imperial police, and the Special Branch became the workhorse of imperial security. It is this hybrid form, intelligence married to policing and armed with emergency legal powers, that successor states would find most useful and would inherit most completely.

India sat at the historical centre of this machine. The subcontinent produced one of the oldest continuously operating intelligence organizations on earth. A central political intelligence body had existed under the Raj since the 1880s, charged with monitoring sedition, tracking revolutionary cells, and reporting on the political temperature of a vast and restive population. By the early twentieth century it had a formal name, a professional cadre, and a doctrine. It read the mail of nationalist leaders. It planted informers inside the Indian National Congress and the revolutionary societies of Bengal and Punjab. It compiled dossiers on figures who would later become founding statesmen of independent India. The apparatus that watched Bhagat Singh and tracked Subhas Chandra Bose across continents was not an aberration of empire. It was empire functioning exactly as designed.

The reach of this apparatus extended well beyond the subcontinent itself. The imperial state understood that Indian nationalism was a transnational movement, with exiles, students, and revolutionaries organizing in London, in Paris, in Berlin, in San Francisco, and in Tokyo. To watch that diaspora, the Raj maintained a specialized organization, Indian Political Intelligence, that operated for decades out of London and cooperated closely with the metropolitan security services. Its officers tracked the movements of suspect individuals, intercepted their correspondence, monitored their publications, and built a documentary record of the anti-colonial movement that spanned continents and generations. The lesson embedded in that organization, that a security service must follow a political threat across borders rather than wait for it at home, was a genuinely offensive intelligence principle, and it was being practised against Indians long before any Indian service practised it on behalf of India.

The day to day tradecraft of this watching apparatus is worth describing, because it is the practical content of what the successor states would later receive. The colonial political branch lived on human sources, and the cultivation of those sources was its central craft. An informant might be a clerk in a nationalist office, a printer who set seditious pamphlets, a servant in a suspect household, a railway official who noticed who travelled where, or a disaffected member of a revolutionary cell who had been identified and quietly persuaded to report. Each source had to be recruited, assessed, paid or otherwise rewarded, protected from exposure, and handled by an officer who knew how to draw out what the source knew without alarming the people the source moved among. Alongside the human network ran the interception of correspondence, the steaming open and copying of letters that passed through the colonial post, and the monitoring of the vernacular press for the early signals of organized dissent. The accumulated product of all this effort was the file, the dossier on an individual or an organization that grew thicker year by year and that constituted the institutional memory of the surveillance state. A new officer arriving in a district inherited the files of his predecessors and with them a ready-made picture of who in his territory was to be watched. This patient, file-based, source-driven method was the working substance of colonial political intelligence, and it was this method, rather than any single dramatic operation, that the successor services absorbed most completely, because it was embedded in the routines of the organization itself.

Over its long life, the imperial intelligence machine also developed a distinctive relationship with the law. The Raj governed a population it did not trust and could not consult, and it equipped itself accordingly with a body of legislation designed for control rather than for justice. Preventive detention, the power to imprison a person not for a proven offence but for what the state judged they might do, was a standing feature of colonial governance. Powers to restrict movement, to ban organizations, to censor publications, and to disperse assemblies were always available. The infamous wartime and post-war security legislation, against which the independence movement campaigned with particular bitterness, gave the imperial state the authority to act against political activity with minimal judicial check. These legal instruments were not incidental to the intelligence machine. They were its enabling framework, the architecture that converted a surveillance report into a detention order. Any successor state that inherited the machine would also, if it chose, inherit the legal architecture that made the machine effective.

The triggers that turned this watching machine into an instrument of active covert warfare were the insurgencies of decolonization. Between 1945 and 1967, Britain faced a near-continuous sequence of armed challenges to its remaining possessions. Palestine convulsed before the 1948 withdrawal. Malaya rose in 1948. Kenya erupted in 1952. Cyprus burned from 1955. Aden became ungovernable after 1963. Each emergency forced the imperial state to move beyond passive surveillance into something more aggressive: the penetration of armed movements, the recruitment and turning of fighters, the targeted removal of insurgent commanders, and the reshaping of entire civilian populations to deny the insurgency its base. The campaigns were officially defensive, framed as the restoration of order against criminal violence. In practice they were offensive intelligence operations on a large scale, and they generated a body of covert technique that outlived the empire that produced it.

It matters that these were not wars in the conventional sense. Britain almost never described them as such. The vocabulary was deliberate. Malaya was an emergency. Kenya was an emergency. The fighters were bandits, terrorists, or gangsters, never soldiers. This linguistic discipline served a purpose beyond insurance premiums. By denying the insurgents the status of combatants, the imperial state freed itself from the legal architecture of war and operated instead under emergency regulations of its own design. That same instinct, the preference for a deniable category of conflict that sits below the threshold of declared war, would reappear decades later in the doctrines of states conducting covert campaigns against non-state enemies. India’s own shadow war against terror operates in exactly this deniable space, and the instinct for it is older than independent India itself.

The Malaya Emergency and the Templer System

The Malayan Emergency began with the Malayan Communist Party’s decision in 1948 to abandon constitutional politics for armed struggle. The party had emerged from the wartime resistance to Japanese occupation, during which Britain had armed and trained its guerrilla wing. Those weapons and that training were now turned against the returning colonial power. The party’s fighting arm, eventually titled the Malayan Races Liberation Army, drew its recruits overwhelmingly from the ethnic Chinese population, and in particular from the half-million Chinese squatters who farmed the fringes of the jungle without legal title to their land. These squatters were the insurgency’s lifeline. They grew its food, carried its messages, and sheltered its fighters, sometimes willingly and sometimes under coercion. The guerrilla commander Chin Peng, a veteran of the anti-Japanese resistance who had once received a British decoration, understood that his movement lived or died by its connection to that population.

For the first two years, the colonial response floundered. The army conducted large jungle sweeps that exhausted soldiers and rarely found the enemy. The police were undermanned and poorly led. Intelligence was fragmentary, scattered across competing organizations, and slow to reach the units that needed it. The killing of insurgents proceeded, but the insurgency itself did not shrink, because the imperial state was attacking the visible armed body of the movement while leaving its hidden support structure untouched.

The failure of those early years is instructive in its own right, because it shows what the later doctrine was a reaction against. Battalion-scale sweeps through the jungle were the natural instinct of an army trained for conventional war, and they failed for a reason the campaign would eventually learn to articulate. A large force moving through the forest announced itself for miles, allowing the guerrillas to simply step aside and let it pass. The contacts that did occur were accidental, costly, and rare. The mathematics were hopeless: thousands of soldiers, weeks in the field, and a handful of insurgents killed. Worse, the sweeps alienated the rural population whose cooperation the campaign actually needed, because a heavy military presence brought disruption, suspicion, and occasional abuse. The lesson, painfully absorbed, was that mass force applied without precise intelligence was not merely ineffective but counterproductive. It consumed resources, it produced no decisive result, and it damaged the relationship with the population that was the true foundation of any victory. Everything that followed, the resettlement, the rebuilt Special Branch, the intelligence-led strikes, was a deliberate correction of that early error.

The first decisive correction came from a soldier and administrator named Harold Briggs, appointed Director of Operations in 1950. Briggs grasped the central problem with a clarity his predecessors had lacked. The guerrillas could not be defeated in the jungle because the jungle was not where their strength lay. Their strength lay in the squatter settlements that fed them. The plan that bore his name, the Briggs Plan, set out to sever that link by physically relocating the squatter population. Over the following years, roughly half a million people, the great majority of them ethnic Chinese, were moved from their scattered jungle-edge farms into some five hundred newly built and tightly controlled settlements known as New Villages. These villages were fenced, lit, patrolled, and subject to curfew and food rationing. Every gram of rice was accounted for, so that none could be smuggled to the fighters in the trees.

In the language of a later era, the Briggs Plan was a programme of population control. It was coercive, it uprooted a community on an enormous scale, and it caused real hardship. It was also, in narrowly operational terms, effective, because it began to starve the insurgency of the food, recruits, and information it needed. Briggs had identified the principle that would define the campaign: the contest was not for territory but for the population, and intelligence was the means of winning it.

The resettlement was only the visible half of the food denial strategy. Alongside the New Villages, the imperial state built an intricate system of rationing, registration, and physical control designed to ensure that not a single surplus grain of rice could leave a settlement and reach the jungle. Shopkeepers were licensed and their stocks audited. Cooked rice, which could be carried into the trees without further preparation, was treated with particular suspicion. Workers leaving a village for the rubber estates or the tin mines were searched. Where a settlement was judged to be feeding the guerrillas, the authorities imposed collective punishment in the form of tighter curfews and reduced rations, a coercive pressure intended to turn the population against the fighters who were the cause of the hardship. Specific food denial operations were mounted against districts where the insurgency remained strong, squeezing the guerrillas until hunger forced them either to surrender or to expose themselves in increasingly desperate attempts to find supplies. The strategy was slow, unglamorous, and administratively demanding, and it worked precisely because it attacked the insurgency where it was weak rather than where it was strong.

The second and more famous correction came after a shock. In October 1951, the High Commissioner of Malaya, Henry Gurney, was ambushed and killed on a road in the Cameron Highlands. The assassination of the colony’s senior civil official forced a reckoning in London. The man chosen to replace him was Gerald Templer, a career soldier given an unprecedented concentration of authority. Templer became both High Commissioner and Director of Operations, fusing the civil and military command of the colony in a single pair of hands. That fusion was itself a doctrinal innovation. Counter-insurgency, Templer believed, could not be run as a war on one desk and a government on another. It had to be a single integrated effort in which administration, policing, military force, and intelligence all answered to one authority and pulled in one direction.

Templer’s name is forever attached to the phrase about winning hearts and minds, and the phrase has been quoted so often that its meaning has thinned into sentiment. What Templer actually meant was harder edged. The population was the prize, and the population would side with whichever power could offer it security, services, and a credible future. Winning hearts and minds was not kindness. It was a calculated bid for the loyalty of a frightened people, pursued precisely because that loyalty produced the one resource the campaign could not win without, namely information. A villager who trusted the government would talk. A villager who feared the guerrillas more than the government would talk. And talk, converted into intelligence and acted upon quickly, was what killed insurgents.

The instrument that converted talk into action was Special Branch. Templer and his intelligence reformers, among them the police officer Guy Madoc, rebuilt the Malayan Special Branch into the central nervous system of the campaign. Before the reforms, intelligence had been a confused competition between army staffs, the regular police, and the political branch. After them, Special Branch became the undisputed lead, the single body responsible for running agents, debriefing sources, building the picture of the insurgent organization, and feeding precise targeting information to the units in the field. The army, for the first time, was placed in support of the intelligence effort rather than the other way around. Soldiers no longer thrashed through the jungle hoping to bump into the enemy. They moved on the basis of a name, a location, and a window of time, supplied by an agent that Special Branch was running.

Many of the agents themselves came from the ranks of the insurgency. The imperial state developed an elaborate programme around what it termed surrendered enemy personnel. A guerrilla who surrendered, or who was captured and then turned, was a strategic asset of the highest order. He knew the camps, the couriers, the supply routes, and the personalities. He could identify a face that no colonial officer would recognize. Some surrendered fighters were used simply as sources of information. Others were sent back into the jungle, sometimes in the company of soldiers, sometimes alone, to make contact with their former comrades and either persuade them to surrender or guide a strike force onto them. Generous cash rewards were posted for information leading to the death or capture of named commanders, and the rewards were scaled by seniority, so that the price on a district leader’s head far exceeded the price on a rank-and-file fighter. The campaign was, in effect, a market in betrayal, and Special Branch was its exchange.

The surrender programme was reinforced by a sustained propaganda effort that ran in parallel with the intelligence work and was, in its way, an extension of it. The imperial state flooded the contested districts with leaflets, many of them dropped from the air, that promised good treatment to those who gave themselves up and that publicized, with names and photographs, the surrenders that had already occurred. Aircraft fitted with loudspeakers flew over the jungle broadcasting appeals, sometimes in the recorded voice of a recently surrendered commander addressing his former unit by name. The psychological objective was to corrode the cohesion of the insurgent groups from within, to make every fighter wonder whether the man beside him was about to surrender and inform, and to present surrender not as a shameful betrayal but as a rational and survivable choice. Propaganda of this kind was not separate from the intelligence campaign. It fed the campaign, because every fighter it brought out of the jungle was a potential source, and the picture that Special Branch held of the insurgent organization grew sharper with each surrender.

This is the point at which the Malayan model becomes directly legible as the ancestor of much later covert practice. The campaign’s lethal edge was not mass firepower. It was precision, and the precision came from intelligence. A commander was located through a turned source, fixed in place by surveillance, and then eliminated by a small force acting on a tight schedule. The logic was decapitation: the patient, sequential removal of an insurgent leadership faster than it could be replaced, so that the movement lost not merely fighters but the experienced cadres who gave it coherence. When India’s covert operations doctrine later evolved toward the targeted elimination of terrorist leaders, it was operating, whether consciously or not, on a principle that Templer’s Malaya had already proven.

It would be a mistake, however, to remember the Malayan campaign purely as the clean and disciplined success that its later promoters preferred to present. The model rested on coercion, and the coercion was real. Detention without trial was used on a large scale, and thousands of people were held under emergency regulations on the basis of suspicion rather than proven offence. Deportation was a standing instrument, and tens of thousands of ethnic Chinese, including many who had no demonstrable connection to the insurgency, were removed from the colony to China. Collective punishments were imposed on settlements judged uncooperative, in the form of curfews that prevented people from working and ration cuts that brought real hunger. The early phase of the campaign had also seen a notorious incident in which a patrol killed a number of unarmed villagers, an event the authorities recorded as the deaths of bandits and which became, much later, the subject of a long and unresolved controversy. The Malayan campaign was more disciplined than the Kenyan one that ran alongside it, and it produced no single scandal of the magnitude of the Hola deaths. But its discipline was relative, not absolute, and the New Villages, the mass detention, and the deportations were coercive instruments by any honest measure. The point matters for the inheritance, because the successor states that studied Malaya as a model were studying a campaign whose effectiveness was inseparable from its willingness to detain, deport, and resettle on a vast scale. To inherit the model was to inherit that willingness as one of its working assumptions.

By 1960, the Malayan Emergency was declared over. The Malayan Communist Party had been broken as a fighting force, its remnants pushed across the Thai border, its leadership decimated by exactly the intelligence-led targeting that Special Branch had perfected. The imperial state then did something significant with its victory. It packaged the Malayan campaign as a model. Officers who had served there wrote it up, lectured on it, and carried its lessons to other theatres. The Malayan emergency became the canonical British counter-insurgency success, the campaign every later one would be measured against, and the source of a doctrine that would be exported across the empire and beyond it. India, as a Commonwealth member whose officers attended the same staff colleges and read the same professional literature, was inside the circle of inheritance.

Kenya and the Mau Mau Counter-Insurgency

If Malaya is remembered as the model campaign, Kenya is remembered as the campaign that exposed what the model could become when restraint failed. The two emergencies overlapped in time, drew on the same doctrinal vocabulary, and employed many of the same techniques. They diverged sharply in their conduct and in the moral reckoning that followed.

The Kenyan emergency was declared in October 1952 by the colony’s Governor, Evelyn Baring. The insurgency he confronted, which the colonial authorities labelled Mau Mau and which its own fighters understood as a land and freedom army, arose primarily among the Kikuyu, the largest ethnic group in the colony and the one most directly dispossessed by white settlement. The grievance was concrete. The most fertile highlands of the colony had been reserved for European farmers, and a generation of Kikuyu had been reduced to labourers on land their families had once held. The movement that grew out of that dispossession bound its members through oathing ceremonies and turned, after 1952, to violence against settlers, against the imperial administration, and above all against fellow Africans who were seen as collaborators. The great majority of the people killed by the insurgency were not white settlers but Kikuyu loyalists, a fact that made the Kenyan conflict, like many colonial emergencies, also a civil war within the colonized population.

The colonial response in Kenya reproduced the Malayan template but applied it with far greater harshness, in a settler society where the European population exerted relentless pressure for severity. Three components of the Kenyan campaign deserve particular attention, because each represents a colonial covert or coercive technique that fed into the wider imperial repertoire.

Before examining those three components, it is necessary to understand the social texture of the conflict, because that texture shaped the intelligence problem. The insurgency bound its members through oathing, a ceremony that committed the participant to the movement and to secrecy under a powerful cultural sanction. Oathing made the movement cohesive and made it extraordinarily difficult to penetrate, because a person who had taken the oath was bound by something deeper than ordinary political loyalty. The colonial state, in response, came to treat the breaking of the oath as a central objective of its detention and screening system, and developed what it called rehabilitation as the supposed instrument for achieving it. At the same time, a large part of the Kikuyu population did not take the oath or actively opposed the movement, and the colonial state armed and organized these loyalists into a Home Guard that fought the insurgency directly. The Home Guard did much of the campaign’s hardest and most intimate fighting, and it meant that the conflict was, to a degree often underplayed in later memory, a civil war within the Kikuyu community itself. For the intelligence machine, the loyalist population was indispensable. The loyalists could name the oathed, identify the couriers, and point to the safe houses, and the colonial campaign depended on them precisely as the Malayan campaign had depended on the information of a population it had managed to bring onto its side.

The first was the mass screening and detention system. In April 1954, the colonial state launched Operation Anvil, a vast cordon-and-search sweep of Nairobi. Soldiers and police sealed the city and moved through it neighbourhood by neighbourhood, separating the population by ethnicity and subjecting tens of thousands of Kikuyu men to screening. Those judged to be implicated in the insurgency, or merely suspected of sympathy with it, were detained. Detention then expanded into an archipelago of camps that the administration itself called the Pipeline, through which well over a hundred thousand people passed. The Pipeline was designed not only to hold detainees but to process them, to break the oath that bound them to the movement through a combination of interrogation, labour, and pressure, and to grade them by their supposed degree of rehabilitation. The screening teams that staffed the camps and the reception centres were, in function, an interrogation apparatus, and the intelligence they extracted fed back into the targeting of fighters still at large.

The screening process deserves a closer look, because it reveals how a counter-insurgency campaign turns a civilian population into an intelligence resource. Screening was, in essence, mass interrogation. A detainee passing through the system was questioned, often repeatedly, by teams that frequently included loyalist Kikuyu who could detect a lie, recognize a face, and understand the local web of kinship and obligation in a way no European officer could. The detainee was assessed, classified, and sorted, with the classification determining whether he moved toward release or deeper into the system. The state described the goal as rehabilitation, a progression from hardcore commitment through cooperation to eventual release, and it described the technique for achieving that progression as dilution, the breaking down of a detainee’s resistance. In practice, the language of rehabilitation concealed a regime in which pressure, hard labour, and physical coercion were routine, and in which the line between extracting intelligence and inflicting punishment was rarely observed. The system generated a great deal of information, and that information had operational value, but it did so at a human cost that the colonial state worked hard to keep out of view.

Villagization formed the second component. Following the Malayan precedent of the New Villages, the Kenyan administration forcibly resettled the rural Kikuyu population, more than a million people, into some eight hundred fortified and guarded villages. As in Malaya, the stated logic was the separation of the population from the insurgents, the denial of food and shelter, and the concentration of people where they could be watched and controlled. The human cost was severe. The villages were often hastily built, overcrowded, and unsanitary, and the disruption of agriculture produced hunger.

The third component, and the one most directly relevant to the history of covert technique, was the pseudo-gang. The pseudo-gang was a small unit composed of turned former insurgents, often led or accompanied by a European officer in disguise, that moved through the forest pretending to be a genuine Mau Mau band. Its purpose was to make contact with real insurgent groups, gather intelligence on their location and strength, and then either capture them or guide a strike force onto them. The technique was developed and refined in Kenya by a young army officer named Frank Kitson, whose subsequent writing would carry the pseudo-gang concept into the permanent doctrine of British counter-insurgency. The pseudo-gang was, in its essence, a deception operation built on betrayal. It exploited the fact that a turned insurgent could pass as one of his former comrades, and it weaponized that intimacy. The line between an intelligence-gathering pseudo-gang and a deniable killing squad was, in practice, thin, and in Kenya it was frequently crossed.

The pseudo-gang worked because it solved the hardest problem in counter-insurgency, which is contact. An insurgency that hides among the population and in difficult terrain can be almost impossible for a uniformed force to find. The pseudo-gang inverted the problem. Rather than searching for the enemy, it persuaded the enemy to come to it, by presenting a face the enemy recognized and trusted. A genuine insurgent band, encountering what it believed to be a friendly group, would relax, share information, and reveal its dispositions. The intelligence value of a single such encounter could be enormous. But the technique also carried a moral hazard that the colonial campaign never fully resolved. A unit built on deception and staffed by men who had switched sides operated, by its nature, in the shadows, beyond easy supervision, and with a licence to use violence that was difficult to monitor. The turned fighters who staffed the pseudo-gangs had powerful incentives to demonstrate their reliability through results, and results often meant kills. The pseudo-gang was therefore both a brilliant intelligence instrument and a standing temptation toward extrajudicial killing, and that double character is part of what it bequeathed to the doctrine.

Kenya’s emergency also produced the scandal that, more than any other single event, forced the British public and Parliament to confront the reality of colonial counter-insurgency. In March 1959, at a detention camp called Hola, eleven detainees who had refused forced labour were beaten to death by their guards. The colonial administration initially attributed the deaths to contaminated drinking water, a cover story that collapsed under scrutiny. The Hola massacre became a parliamentary crisis. It punctured the official narrative of a firm but lawful campaign and exposed the violence embedded in the detention system. Coupled with mounting unease about the conduct of the war, Hola contributed to the political shift that would, within a few years, carry Kenya to independence.

The full human cost of the Kenyan emergency remained contested for decades. The colonial-era figure for insurgents killed stood at around eleven thousand, with far smaller numbers of European and loyalist African dead. Later historical scholarship, drawing on archives and testimony that the British government had long withheld, argued that the true toll of the detention system, the villages, and the wider campaign was far higher, and that the colonial state had concealed the scale of its own coercion. In 2013, after a legal battle, the British government accepted a financial settlement with surviving Kenyan claimants and expressed regret for the abuses of the era. The fact that this reckoning took half a century is itself part of the story, because it illustrates how completely the covert and coercive machinery of a colonial emergency could be sealed off from public knowledge, and for how long.

Underpinning the whole Kenyan campaign was a legal regime built specifically to enable it, and that regime is as much a part of the colonial inheritance as any field technique. The declaration of emergency in 1952 activated a body of regulations that gave the colonial executive sweeping powers exercised with minimal judicial restraint. Detention without trial became routine and was applied to a population numbering in the hundreds of thousands across the life of the emergency. Special courts operated under emergency rules, and the death penalty was extended to a range of offences associated with the insurgency, including the administering of oaths and the possession of arms or ammunition, with the result that the colonial state hanged over a thousand people in the course of the campaign. Curfews, collective fines, the confiscation of land and livestock, and the designation of large areas as special districts subject to restricted movement were all available to the administration as ordinary tools of governance. The legal architecture mattered because it was what converted the intelligence product into action. A name extracted in a screening camp could become a detention order, a prosecution, or an entry on a list of those to be hunted, and the speed of that conversion depended on a legal system designed to remove the friction that ordinary criminal procedure would have introduced. When successor states retained emergency legislation and preventive detention, they were retaining precisely this enabling architecture, the legal machinery without which the intelligence machine could collect but could not strike.

Kenya, then, sits in this history as both a continuation of the Malayan model and a warning about it. The same doctrinal kit, intelligence-led targeting, population resettlement, the turning of insurgents, the pseudo-gang, was in use. What differed was the restraint, or its absence. The lesson that careful officers drew from the comparison was not that the techniques were wrong but that they were dangerous, that an intelligence-led counter-insurgency without firm legal and political control would slide into exactly the abuses that destroyed its own legitimacy. That lesson, the double-edged nature of the colonial covert toolkit, is one that successor states inherited along with the techniques themselves.

Aden, Cyprus, and the Twilight Colonial Campaigns

By the time the Kenyan emergency closed, the British Empire was contracting fast, and the final colonial campaigns were fought in the knowledge that the territories at stake would soon be lost. Two of these twilight emergencies, Cyprus and Aden, completed the colonial education in covert operations and added their own lessons to the inherited body of doctrine.

Cyprus erupted in 1955, when a movement seeking union with Greece, organized as EOKA and led by the former Greek army officer George Grivas, began a campaign of bombing and assassination against the British administration. The Cyprus emergency was, in counter-insurgency terms, an urban and small-island problem rather than a jungle one, and it stretched the imperial intelligence machine in unfamiliar ways. Grivas himself was never captured, despite an enormous effort to locate him, and his survival underlined a hard truth about insurgent leadership: a commander who maintained rigorous personal security, trusted almost no one, and stayed mobile could defeat even a determined intelligence hunt. The Cyprus campaign also drew Britain into the interrogation controversies that shadowed every colonial emergency, with allegations of mistreatment that foreshadowed later and better-documented scandals.

Cyprus carried a second lesson that mattered for the transmission of doctrine. The island was ethnically divided, and the colonial state, facing a movement drawn overwhelmingly from one community, was able to recruit auxiliary police and informants disproportionately from the other. This was the same logic that had armed the loyalist Home Guard in Kenya and that had drawn the colonial state in Malaya toward one ethnic community against another. A divided population was, from the cold perspective of the intelligence machine, an opportunity, because division supplied the informants, the auxiliaries, and the local knowledge that penetration required. The technique of exploiting communal fracture to build an intelligence base was never written into a manual as openly as the pseudo-gang or the resettlement scheme, but it was a consistent feature of colonial practice, and it was among the more troubling habits that successor states, governing their own divided populations, were positioned to inherit.

Aden was the harsher and more instructive case. The port of Aden and its surrounding protectorates at the southern tip of Arabia became, after 1963, the scene of an insurgency driven by Arab nationalism and by rival movements, principally the National Liberation Front and the Front for the Liberation of Occupied South Yemen, that fought the British and each other. The Aden emergency is remembered within the history of British intelligence for a specific and painful reason. The local Special Branch, the very organization that the Malayan model placed at the heart of any successful campaign, was systematically penetrated and then destroyed by the insurgents. Special Branch officers were identified and assassinated in the streets. The intelligence machine that the colonial state needed most was killed off precisely because the insurgents understood, as well as the British did, that Special Branch was the decisive instrument. Without it, the campaign was effectively blind.

Aden taught the imperial intelligence community a lesson that runs in the opposite direction to the Malayan triumph. Malaya proved what a well-run, well-protected, locally rooted Special Branch could achieve. Aden proved how catastrophic it was to lose one, and how an insurgency that grasped the centrality of intelligence could win simply by destroying the other side’s capacity to collect it. The British position in South Arabia became untenable, and the withdrawal of 1967 closed the colony in conditions close to defeat. Aden also generated its own interrogation scandal, centred on a detention and questioning facility where allegations of abuse drew the attention of human rights campaigners and forced an official inquiry. The pattern by now was depressingly familiar: an emergency, an intelligence machine pushed to extract information at speed, and a controversy over the methods used to do so.

The Aden experience carried a transmissible lesson that successor states were positioned to absorb, and it was a lesson about vulnerability rather than about technique. Malaya had taught the colonial world how to build an intelligence machine. Aden taught it how easily that machine could be destroyed by an opponent who understood its importance. An insurgency that systematically identified, exposed, and killed the officers of the political branch could blind the state more cheaply and more completely than it could ever hope to defeat the state in open battle. The defensive implication was clear. An intelligence service had to protect the identities of its officers and its sources as fiercely as it pursued the enemy, because the loss of that secrecy was not a setback but a defeat. The successor services that inherited the colonial machine inherited this lesson too, and the obsessive secrecy that surrounds the identities of intelligence officers in the post-colonial states of the region is, in part, a direct response to the demonstration that Aden provided. The protection of the service from penetration became understood as a precondition of every other function, because a penetrated service is not merely weakened but inverted, its sources turned, its operations betrayed, and its officers marked. Aden was the case study that fixed that understanding in colonial doctrine.

The figure who threads these twilight campaigns together and carries their lessons forward is Frank Kitson. Kitson had built his reputation with the pseudo-gangs of Kenya. He served subsequently in other theatres of the contracting empire, and he distilled what he had learned into two books that became foundational texts of counter-insurgency thinking. The first set out the gangs and counter-gangs technique he had pioneered. The second, written at the start of the 1970s, generalized the colonial experience into a theory of what Kitson called low intensity operations, a category of conflict below the threshold of conventional war in which intelligence, not firepower, was the decisive factor and in which the contest for the population was everything. Kitson’s work mattered because it took the scattered, improvised, often brutal experience of a dozen colonial emergencies and turned it into transmissible doctrine. Doctrine, unlike experience, can be taught. It can be read in a staff college on another continent by an officer of a different nationality. It outlives the empire that generated it. And it is doctrine, far more than any single operation, that constitutes the real colonial inheritance.

These twilight campaigns also coincided with a deliberate act of concealment by the departing imperial power. As colony after colony approached independence, the British administration conducted a systematic purge of its own records. Sensitive files, especially those documenting the coercive and covert side of colonial rule, were either destroyed or removed to Britain and held in secret rather than handed to the successor government. The migrated archive, as it later became known, was a calculated decision to control the historical record of empire and, in particular, to keep the most compromising documentation of imperial intelligence work out of the hands of the new states. The successor states therefore inherited the institutions, the personnel, and the operational habits of the colonial intelligence machine, but not the full written memory of how that machine had actually behaved. They inherited the practice without the confession.

Key Figures

The colonial shadow wars were shaped by individuals, and three figures in particular illuminate how the covert doctrine of empire was made and transmitted.

Gerald Templer

Templer is the central figure of the Malayan model and, by extension, of the entire British counter-insurgency tradition. His decisive contribution was structural. By holding both the civil and military authority of the colony in a single office, he ended the fragmentation that had crippled the early years of the Malayan Emergency and proved that counter-insurgency had to be run as one integrated effort rather than a collection of competing departments. He elevated intelligence, and Special Branch specifically, to the leading role in the campaign, subordinating military operations to the intelligence picture rather than the reverse. He understood the population as the true strategic terrain. His reputation as the architect of the one undisputed British counter-insurgency success made his methods authoritative, and authority is what turned the Malayan experience into exportable doctrine. Every later officer who argued that intelligence must lead, that the population must be won, and that command must be unified was, knowingly or not, repeating Templer.

What is sometimes lost in the admiring accounts of Templer is that his integrated command was also a centralization of coercive power. The same unified authority that allowed intelligence, policing, and military force to be coordinated also meant that emergency detention, resettlement, collective punishment, and lethal operations all answered to a single will, with the ordinary checks of separated civil and military authority removed. Templer’s structure was effective precisely because it concentrated power, and concentrated power is a double-edged inheritance. A successor state that adopts the integrated counter-insurgency command adopts an instrument that is as efficient at coercion as it is at coordination, and the quality of the outcome depends entirely on the restraint of the hand that holds it.

Frank Kitson

If Templer supplied the strategic architecture, Kitson supplied the covert technique and, crucially, the theory that made it teachable. As a young officer in Kenya he developed the pseudo-gang into a refined instrument, demonstrating that turned insurgents, properly handled, could be used not merely as informants but as active operators inserted back into the enemy’s own ranks. His later writing generalized this and the broader colonial experience into a doctrine of low intensity operations that placed intelligence and the contest for the population at the centre of all such conflict. Kitson’s importance to this history is that he is the transmission mechanism. Through his published work, the improvised practices of the colonial emergencies became formal doctrine, studied far beyond Britain and far beyond the end of empire.

Kitson’s theoretical contribution was to insist that the decisive battle in this kind of conflict was the battle for information, and that everything else, the military operations, the civil administration, the propaganda, existed to serve the production and exploitation of intelligence. He argued that the insurgent organization had to be mapped before it could be destroyed, that the mapping was the work of patient agent-running and source development, and that the killing or capture of insurgents was the final and almost mechanical step in a process whose hard part came earlier. This was a genuinely influential reframing. It told a generation of officers, in Britain and in the many countries whose forces studied British doctrine, that counter-insurgency was an intelligence discipline first and a military one second. That proposition, more than any single tactic, is the intellectual inheritance that Kitson passed to the post-colonial world.

The Special Branch Architects

The third key figure is not an individual but a type: the Special Branch reformer, the police intelligence officer who built the agent-running, source-handling political branch that the Malayan model placed at the heart of any successful campaign. In Malaya, the police officer Guy Madoc was prominent among those who rebuilt Special Branch into the campaign’s central nervous system. Across the empire, officers of this kind performed the same function in colony after colony. They mattered because Special Branch was the institutional form in which the colonial intelligence machine actually lived. It was Special Branch, more than MI5 or the Secret Intelligence Service, that the successor states inherited most directly, because Special Branch units were embedded in the imperial police forces that became national police forces overnight at independence. The architects of colonial Special Branch were, in a real sense, the unwitting founders of the domestic intelligence services of a dozen new nations, India among them.

The Inheritance Pathway: How Partition Transferred the Machine

This history rests on a central claim, which is that India’s intelligence apparatus did not begin in 1947. It was inherited, more or less whole, from the colonial state, and the pathway of that inheritance can be traced with some precision.

The most direct inheritance was the Intelligence Bureau itself. The Raj had operated a central political intelligence organization since the 1880s, and by the twentieth century that organization had a name, a professional cadre, a doctrine, and a vast accumulation of files. Its function was the surveillance of political activity, the penetration of nationalist and revolutionary organizations, the monitoring of the press and of public opinion, and the early identification of sedition. When the British departed, this organization did not dissolve. It was handed across, with its structures and a large part of its personnel intact, to become the Intelligence Bureau of independent India. The country that had been the principal target of colonial political intelligence now owned the principal instrument of it. India also took possession, through Partition, of one half of a divided machine, while the other half passed to the new state of Pakistan, a division that set the two successor services into the intelligence rivalry that would define the contest between RAW and the ISI for decades afterward.

Personnel formed the second inheritance. The senior officers of the new Indian intelligence and police services were, almost without exception, men who had trained and risen within the colonial system. They had served in the Indian Police under British supervision, attended the same courses, absorbed the same operational assumptions, and in many cases worked directly within the apparatus of political surveillance. Independence changed the flag and the chain of command. It did not, and could not, instantly change the professional formation of the people who now ran the machine. Doctrine is carried in the heads of practitioners, and the practitioners of 1948 were colonial practitioners. The first generation of independent India’s intelligence leadership thought about subversion, surveillance, and source-running in the categories the Raj had taught them, because those were the only professional categories they had.

The continuity of personnel was institutionalized in the structure of the police service itself. The colonial Indian Police was succeeded, with deliberate continuity, by the Indian Police Service, an all-India cadre built on the same elite, centralized model. The officers of that service staffed not only the ordinary police but the Special Branch units in the states and, crucially, the upper ranks of the Intelligence Bureau and later of the foreign service as well. The effect was to create a single professional stream, formed in a common training and a common doctrine, that supplied the leadership of India’s entire internal security and intelligence establishment. That stream ran directly out of the colonial system. Its founding generation had learned the trade under the Raj, and they trained the generation that followed them, so that the operational culture of the imperial police reproduced itself through the ordinary mechanism of professional succession long after the colonial state had ceased to exist.

The third inheritance was the legal and structural apparatus of coercion. The colonial state had governed India in significant part through emergency law: preventive detention, restrictions on movement and assembly, censorship powers, and a body of legislation designed to suppress political dissent without the inconvenience of ordinary criminal trial. The independence movement had bitterly opposed these instruments and had suffered under them. Yet the independent Indian state, facing its own security pressures from the moment of its birth, retained much of this legal architecture and used it. The Special Branch units embedded in the provincial police forces, the political intelligence functions of the district administration, the surveillance of designated suspect categories: these survived the transfer of power because the new state found them useful. The institutions of colonial coercion proved remarkably portable, because their portability did not depend on the identity of the government using them. They were tools, and tools serve whoever holds them.

Legal continuity is particularly worth dwelling on, because it is the least visible and the most consequential. Preventive detention, the colonial-era power to imprison a person on the basis of official suspicion rather than proven offence, did not vanish with independence. The independent Indian state enacted its own preventive detention legislation early in its life and retained the instrument, in one statutory form or another, across the decades that followed. The emergency powers that allowed organizations to be banned, areas to be designated as disturbed, and security forces to be granted special legal protections were likewise carried forward and used. These legal instruments were the enabling framework of the intelligence machine, the architecture that allowed a surveillance report to become a detention and a security operation. To inherit the machine without the legal framework would have been to inherit a body without a skeleton. India inherited both, and the legal skeleton, derived from the colonial model of governing a population through emergency authority, remained a working part of the security state.

The fourth and least tangible inheritance was doctrine, the body of operational thinking that the colonial emergencies had produced and codified. India was inside the circle within which that doctrine circulated. Indian officers attended Commonwealth staff courses. They read the professional counter-insurgency literature, including the work of Kitson and the published reflections of the Malayan campaign. When independent India faced its own insurgencies, in the Naga hills, in the north-east, in Punjab, and elsewhere, its security forces reached, naturally and almost inevitably, for the inherited counter-insurgency repertoire: the separation of insurgents from the population, the primacy of intelligence, the cultivation of informant networks, the turning of captured fighters, and the targeted removal of insurgent leadership. These were not Indian inventions. They were the Malayan and Kenyan templates, transmitted through doctrine and applied by officers formed in the colonial tradition.

The application of that inherited repertoire to India’s own insurgencies can be traced campaign by campaign, and the continuities are striking. In the Naga hills, where an armed movement for independence emerged in the 1950s, the Indian state employed regrouping of villages, a resettlement technique recognizably descended from the Malayan New Villages and the Kenyan protected villages, alongside intelligence-led operations and the cultivation of local informants. In Mizoram, facing insurgency in the 1960s, the state again resorted to large-scale village regrouping, concentrating a scattered rural population into controlled settlements along the roads in order to separate the insurgents from their support base. Decades later, when Punjab was convulsed by militancy in the 1980s and early 1990s, the security response again placed intelligence at the centre, built dense networks of informants, turned captured militants into sources, and pursued the systematic identification and elimination of the militant leadership as the decisive measure. The specific contexts differed enormously, but the underlying grammar, the conviction that an insurgency is defeated by intelligence and by the separation of fighters from population, did not. It was the colonial grammar, inherited and applied.

It is worth tracing the specific techniques along this pathway, because the lineage becomes most visible at the level of method. Consider the running of human intelligence networks, the patient construction of webs of paid and coerced informants reaching into hostile communities. This was the daily bread of colonial Special Branch, and it became the daily bread of Indian state intelligence. Consider the recruitment and turning of insurgents, the conversion of a captured or surrendered fighter into a source or an operator. This was the surrendered enemy personnel programme of Malaya and the pseudo-gang technique of Kenya, and versions of it appear throughout the counter-insurgency history of independent India. Consider the targeted elimination of insurgent leaders, the doctrine of decapitation that Templer’s Malaya proved and that Kitson theorized. And consider population control, the management and where necessary the resettlement of civilian communities to deny an insurgency its base, a technique that runs from the New Villages of Malaya through the protected villages of Kenya into the counter-insurgency practice of more than one post-colonial state.

The institutional story did not end with the Intelligence Bureau. For its first two decades, independent India relied on a single organization for both internal and external intelligence, in continuity with the colonial arrangement. It was only after the intelligence failures of the 1962 war with China and the 1965 war with Pakistan that India created a dedicated foreign intelligence service, the Research and Analysis Wing, established in 1968 under R. N. Kao. The new service was modelled in part on the American and other foreign agencies, and it represented a genuine attempt to build something fit for the demands of the Cold War and of an independent regional power. But RAW did not spring from nothing either. It was carved out of the Intelligence Bureau, staffed in its early years by officers drawn from that colonial-descended body, and it carried forward the operational culture of the parent institution. The fuller story of that founding belongs to RAW’s own institutional history, but the essential point for this analysis is that even India’s modern, purpose-built foreign service was not a clean break from the colonial line. It was a branch of the same tree.

The lineage from the colonial covert template to modern Indian practice can therefore be set out as a single connected sequence. The colonial emergencies produced a repertoire of technique: human intelligence networks, the turning of insurgents, the targeted removal of leadership, population control, and the integrated command of intelligence and operations. That repertoire was codified into doctrine by figures such as Kitson and by the official mythology of the Malayan success. The doctrine, together with the institutions and the personnel that embodied it, was transferred to India at the moment of independence through the inheritance of the Intelligence Bureau and the colonial police. India’s intelligence services then applied and developed that inherited repertoire across their own insurgencies for the following decades. And the covert campaign that India conducts against terrorist networks today, whatever its specific modern features, stands at the end of that unbroken line of descent. The motorcycle and the silenced pistol are new. The underlying logic, that an insurgent leadership can be located through intelligence and removed by precise action faster than it can regenerate, is the logic of Templer’s Malaya, inherited and updated.

Conscious Adoption or Bureaucratic Drift

This inheritance is real, but its character is genuinely contested, and any honest treatment of this history has to engage the contest rather than resolve it by assertion. The central question is this: did independent India consciously and deliberately adopt British colonial intelligence methods, choosing them because it judged them effective, or did the continuity happen organically, almost unconsciously, through the simple bureaucratic facts of inherited institutions and inherited personnel? The two readings carry very different implications, and both have serious support.

The case for organic, unconscious continuity is straightforward and powerful. At the moment of independence, India faced overwhelming and immediate security pressures: the violence of Partition, the war over Kashmir, the integration of hundreds of princely states, and the consolidation of a fragile new union. A state in that condition does not have the luxury of designing an intelligence service from first principles. It uses what it has. What India had was the Intelligence Bureau, the colonial police, and a generation of officers trained by the departing power. Continuity, on this reading, was not a choice at all. It was the path of least resistance under crisis, the natural result of keeping a functioning machine running rather than dismantling it in the middle of an emergency. The officers did not consciously decide to think like colonial intelligence men. They simply thought in the only professional categories they possessed, because no other categories were available to them. On this view, the colonial inheritance is a fact of institutional history rather than a deliberate decision, and to call it adoption is to credit the new state with a choice it never actually faced.

Conscious adoption has its own serious case, and it rests on a different kind of evidence. India did not retain every colonial institution and instrument. The independence movement had condemned the apparatus of colonial coercion in the strongest terms, and the new republic could have chosen, as a matter of principle, to dismantle the political surveillance machine, to repeal the emergency legislation, and to build something new. It chose, repeatedly and over decades, not to do so. It retained preventive detention. It kept the Special Branch model. It used the inherited counter-insurgency repertoire deliberately and with evident professional confidence when it faced its own insurgencies. Senior figures in India’s intelligence and security establishment, in their later writings and reflections, displayed a clear awareness of the colonial provenance of their methods and, in many cases, a considered judgement that those methods worked. A decision to keep an inherited tool, made repeatedly, by people who understand where the tool came from, begins to look less like drift and more like choice. On this reading, India did adopt the colonial template, not in a single founding moment but through a long series of decisions to retain rather than discard.

The most defensible position is that the truth lies between these poles and contains elements of both. The initial inheritance was genuinely organic, the unavoidable consequence of building a state under crisis from the materials at hand. But the persistence of the colonial template over the following decades, its survival through changes of government, its deliberate application in new theatres, and its evident endorsement by professionals who knew its history, moved it from accident into something closer to ratified choice. India inherited the machine by necessity and then, having inherited it, chose to keep it because it judged that the machine performed.

This adjudication matters because it bears on how the colonial methods appear in modern Indian practice, and they do appear, unmistakably, across the full range of that practice. The primacy of intelligence over firepower, the conviction that insurgency is defeated by knowing rather than by mass force, runs through Indian counter-insurgency doctrine and is a direct descendant of the Malayan lesson. The integration of intelligence, police, military, and civil effort under unified direction, Templer’s structural innovation, is recognizable in the way India organizes its responses to internal armed challenges. The cultivation of dense human intelligence networks and the systematic turning of captured insurgents are standard practice. And the doctrine of decapitation, the targeted removal of an insurgent or terrorist leadership as the decisive blow, is visible in the logic of India’s covert campaigns against the networks operating from across its western border. None of this is to claim that India simply copied a manual. It is to observe that the conceptual furniture of Indian intelligence and counter-insurgency, the basic assumptions about what works and why, was supplied by the colonial inheritance, whether that inheritance is best described as accepted or merely retained.

It is also worth placing India’s case in comparative perspective, because the colonial inheritance was not India’s alone. The British counter-insurgency doctrine forged in Malaya and Kenya influenced security services well beyond the former empire. The American military’s own counter-insurgency thinking drew heavily on the British colonial campaigns, and the logic of intelligence-led targeting that ran through the colonial emergencies is recognizable in the American drone campaign that decades later sought to decapitate militant networks from the air. Other intelligence traditions developed parallel doctrines from their own histories, and a comparison with Israel’s targeted operations or with the Soviet and Russian assassination tradition shows that the patient, intelligence-led removal of an enemy’s leadership is a technique that several modern states arrived at, sometimes by inheritance and sometimes by independent invention. India’s distinctiveness is not that it practises decapitation. It is that India practises it with an institutional culture descended, more directly than most, from the specific colonial machine that the British built and left behind.

The comparison with the other successor states of the British Empire sharpens the point further. The colonial intelligence machine was not transferred to India alone. It was transferred, in its local form, to every territory that became independent, and Pakistan in particular received its own portion of the same machine at the same moment of Partition. The two successor services, having emerged from a common colonial parent, then evolved in divergent directions shaped by the very different political systems they came to serve. That shared origin and subsequent divergence is itself a major theme of the regional intelligence story, and it underlies the long contest that has run between the Indian and Pakistani services ever since. The point for the present analysis is that the colonial inheritance was a regional inheritance, not a uniquely Indian one, and that the differences between the successor services are differences of evolution rather than of origin. They started from the same template. What separated them was what each chose to do with it.

There is one further dimension of the debate worth naming, which is the question of whether the inheritance can ever be fully shed. An institution can be reformed, re-staffed, and re-equipped. New legal frameworks can be written, new oversight bodies created, new doctrines adopted. But the foundational assumptions of an organization, the tacit sense of what the work is and how it is properly done, are transmitted through training, mentorship, and professional culture, and they are extraordinarily durable. A service that was founded on a colonial template will tend to reproduce the template’s assumptions even as its formal structures change, simply because each generation of officers is trained by the last. This does not mean that change is impossible. It means that change is slow, that it requires conscious effort, and that it has to contend with the gravitational pull of an inherited culture. The colonial inheritance, on this view, is not a fixed condition that a state either keeps or discards. It is a starting point that a state can move away from only deliberately and only over time.

Why It Still Matters: The Irony of Inheriting the Master’s Tools

There is a deep irony at the centre of this history, and it is worth stating plainly rather than softening it. The intelligence apparatus that the independent Indian state inherited was, in its original purpose, an instrument of subjugation. The central political intelligence organization of the Raj existed to watch, infiltrate, and disrupt the Indian independence movement. It read the correspondence of the men who would become India’s founding leaders. It planted informers inside the Indian National Congress. It tracked revolutionaries, compiled dossiers on nationalist organizers, and supplied the colonial state with the knowledge it needed to imprison, exile, and on occasion hang the people who fought for Indian freedom. The machine was built to defeat the very movement that, in 1947, took possession of it.

This is the irony of inheriting the master’s tools. The colonized state did not destroy the apparatus that had oppressed it. It kept the apparatus, turned it outward and forward, and made it serve the security of the new nation. The same Special Branch tradition that had once surveilled Congress activists now surveilled threats to independent India. The same doctrine of intelligence-led counter-insurgency that the empire had used to suppress anti-colonial insurgencies was now used by a post-colonial state against insurgencies of its own. The instrument did not change. Its owner did. And because an intelligence machine is, at bottom, indifferent to the political content of the cause it serves, the transfer was seamless. A surveillance network does not know whether it is defending an empire or a republic. It simply collects, reports, and targets, for whoever commands it.

That indifference is precisely why this history still matters, and why it should be understood rather than buried. The covert techniques refined in the colonial shadow wars, the informant networks, the turning of fighters, the pseudo-gangs, the decapitation of leadership, the management of populations, were genuinely effective at the narrow task of defeating an armed movement. That is why they were inherited, retained, and used. But the colonial record also demonstrates, with brutal clarity, what those same techniques produce when they are not held under firm legal and political control. Kenya’s detention camps, the Hola killings, the interrogation scandals of Aden and Cyprus, and the systematic concealment of the colonial archive all show the other face of the inheritance. The colonial covert toolkit is powerful and double-edged, and the state that inherits the power inherits the danger with it.

The concealment dimension deserves particular emphasis, because it points to a structural rather than an incidental problem. The colonial state did not merely commit abuses. It built, as a matter of routine, the institutional capacity to hide them, through cover stories, through controlled inquiries, through the classification of records, and ultimately through the physical destruction and removal of the documentary trail. Concealment was not a failure of the colonial intelligence machine. It was one of the machine’s functions. A successor state that inherits an intelligence apparatus inherits, along with its operational capacity, this same instinct and capacity for self-concealment, and that instinct is at war with the kind of public accountability that a democratic state is supposed to maintain. The danger is not only that covert techniques can be abused. It is that the same apparatus which conducts the covert work is also institutionally equipped to ensure that the abuse never becomes visible. This is the deepest reason that the colonial history is a live concern rather than a settled one, because the structural tension between secret capability and democratic accountability did not end with the empire. It was inherited.

For India, and for any country whose intelligence services descend from this lineage, the practical consequence is a permanent tension. The inherited doctrine says that intelligence must lead, that the insurgent leadership must be removed, that the population must be controlled and won, and that all of this works best when it operates in a deniable space below the threshold of declared war. India’s modern covert campaign against the terrorist networks sheltered across its western border operates squarely within that inherited logic. The targeting of leadership, the reliance on intelligence over mass force, the preference for precise and deniable action: these are the colonial templates, updated for a new enemy and a new technology. The campaign’s defenders argue, with reason, that it is effective, that it imposes real costs on the networks that plan attacks against India, and that it does so with far greater discrimination than the mass-firepower alternatives. The colonial history supplies a complementary warning, that intelligence-led covert campaigns drift toward abuse and toward the concealment of that abuse whenever the controlling legal and political framework weakens. Both the promise and the warning are part of the inheritance, and a mature state has to hold both in mind at once.

There is a further reason this history matters, which is the matter of self-knowledge. A country that does not understand the colonial origins of its own intelligence culture is liable to misread that culture as natural, as simply the way things are done, rather than as the contingent product of a specific and morally compromised history. Understanding the lineage is not an exercise in guilt. The officers who built independent India’s intelligence services did what the security of a new and threatened nation demanded, and they cannot reasonably be faulted for using the only professional tools they had been given. But understanding the lineage does change how the present should be examined. It means recognizing that the deniable, intelligence-led, leadership-targeting model of covert action is not a timeless truth handed down by strategic logic. It is an inheritance, with an author, a history, and a documented record of both its successes and its abuses. The colonial shadow wars were the laboratory. India’s intelligence services were among the heirs. And India’s covert operations doctrine carries that inheritance forward, which is exactly why the colonial history is not a closed museum exhibit but a living part of how the present should be read.

The empire that fought in the rubber estates of Perak and the forests of the Kenyan highlands has been gone for more than half a century. Its covert doctrine has not gone anywhere. It was written down, taught, exported, and inherited, and it lives on in the institutions, the assumptions, and the operational instincts of the states that the empire created on its way out. To trace the line from a planters’ murder in 1948 to a targeted killing in the present is not to indulge in historical decoration. It is to recover the actual genealogy of a way of fighting, and to insist that a state which still uses these methods should at least know where they came from.

Frequently Asked Questions

What covert operations did MI6 and the wider British intelligence community conduct during the colonial era?

British colonial intelligence work was conducted by a federation of organizations rather than by a single agency. The Security Service handled counter-subversion across the empire through liaison officers in colonial capitals, the Secret Intelligence Service handled genuinely foreign work, and colonial police forces ran the daily surveillance through their political units known as Special Branch. During the decolonization emergencies of 1945 to 1967, these bodies conducted agent penetration of armed movements, the recruitment and turning of insurgents, the targeted removal of insurgent leaders, large-scale interrogation and detention programmes, and population resettlement schemes. The Malayan and Kenyan campaigns were the most fully developed examples.

How did British colonial intelligence influence India’s intelligence services?

The influence was direct, because India did not build its intelligence apparatus from scratch in 1947. It inherited the colonial central political intelligence organization, which became the Intelligence Bureau of independent India. It inherited the colonial police forces with their embedded Special Branch units. Its first generation of intelligence and police leaders were officers trained within the colonial system. And it absorbed the counter-insurgency doctrine that the colonial emergencies had produced. The inheritance covered institutions, personnel, legal instruments, and operational thinking.

What methods did Britain use in Malaya and Kenya?

In Malaya, the key methods were the resettlement of roughly half a million squatters into controlled New Villages to separate the population from the guerrillas, the rebuilding of Special Branch as the campaign’s intelligence core, the use of surrendered and turned insurgents as sources and operators, scaled cash rewards for information on named commanders, and intelligence-led precision strikes against the insurgent leadership. In Kenya, the same template was applied with greater harshness, adding mass screening sweeps such as Operation Anvil, an extensive detention system known as the Pipeline, the forced villagization of more than a million Kikuyu, and the pseudo-gang technique of using disguised turned fighters to penetrate insurgent groups.

Did India inherit British intelligence templates at the moment of independence?

Yes. The most direct inheritance was the Intelligence Bureau, handed across as a functioning organization with much of its structure and personnel intact. India also inherited the colonial police and its Special Branch tradition, a body of emergency legislation including preventive detention, and the counter-insurgency doctrine codified by the colonial campaigns. Partition divided the colonial intelligence machine, with one portion passing to India and another to Pakistan.

What was the Templer approach in Malaya, and why is it considered a model?

Gerald Templer, appointed to govern Malaya in 1952, fused the civil and military authority of the colony in a single office, ending the fragmentation that had crippled the early campaign. He placed intelligence, and Special Branch specifically, in the leading role, subordinating military operations to the intelligence picture. He treated the population as the decisive strategic terrain and pursued its loyalty in order to secure the flow of information that made precise targeting possible. Because Malaya became the one undisputed British counter-insurgency success, the Templer approach acquired enormous authority and was packaged as exportable doctrine.

Who was Frank Kitson and why does he matter to this history?

Frank Kitson was a British army officer who developed the pseudo-gang technique during the Kenyan emergency, using disguised turned insurgents to penetrate and target genuine insurgent groups. His importance lies in transmission. Through two influential books, one on the gangs and counter-gangs technique and a later one theorizing low intensity operations, Kitson converted the scattered, improvised experience of the colonial emergencies into formal, teachable doctrine that could be studied far beyond Britain and far beyond the end of empire.

Is India’s shadow war descended from colonial covert practices?

The lineage is real, though it should be stated carefully. India’s modern covert campaign is not a copy of any colonial manual. But its underlying logic, that an insurgent or terrorist leadership can be located through intelligence and removed by precise, deniable action faster than it can regenerate, is the same logic that the Malayan campaign proved and that colonial doctrine codified. India’s intelligence services carried that inherited repertoire forward through decades of their own insurgencies, and the covert campaign of the present stands at the end of that unbroken line of descent.

How do colonial counter-insurgency methods appear in modern Indian practice?

They appear in several recognizable forms. The conviction that intelligence, not mass firepower, is the decisive weapon in counter-insurgency is a direct descendant of the Malayan lesson. The integration of intelligence, police, military, and civil effort under unified direction reflects Templer’s structural innovation. The cultivation of dense human intelligence networks and the turning of captured insurgents are standard practice with clear colonial ancestry. And the doctrine of decapitation, removing leadership as the decisive blow, runs from Templer’s Malaya into the logic of India’s covert campaigns.

What was the Briggs Plan?

The Briggs Plan was a strategy adopted in Malaya from 1950, named after the Director of Operations Harold Briggs. Its core was the forced resettlement of around half a million rural Chinese squatters, who formed the insurgency’s support base, into roughly five hundred fenced, guarded, and rationed New Villages. The aim was to sever the link between the guerrillas and the population that fed and sheltered them. The plan established the principle that the contest was for the population rather than for territory.

What was the Hola massacre and why was it significant?

The Hola massacre occurred in March 1959 at a detention camp in Kenya, when eleven detainees who refused forced labour were beaten to death by guards. The colonial administration initially blamed contaminated water, a cover story that collapsed. The episode became a parliamentary crisis in Britain, punctured the official narrative of a lawful and restrained campaign, and contributed to the political shift that carried Kenya toward independence. It stands as a clear example of how the coercive machinery of a colonial emergency could produce abuse and then attempt to conceal it.

Why did Britain destroy or hide colonial records as it withdrew?

As colonies approached independence, the British administration systematically purged its files, destroying some and removing others to Britain to be held in secret rather than handed to successor governments. This migrated archive was a deliberate effort to control the historical record of empire and, in particular, to keep the most compromising documentation of colonial intelligence and coercive work out of the hands of the new states. The consequence was that successor states inherited the institutions and the practices of the colonial machine but not the full written memory of how it had behaved.

How does the colonial legacy affect India’s intelligence culture today?

It affects the culture at the level of basic assumptions. A service descended from the colonial machine tends to treat intelligence-led, leadership-targeting, deniable covert action as the natural and obvious approach, when in fact it is a specific historical inheritance with an identifiable author and a documented record. Recognizing the colonial origin does not condemn the practice, but it does mean understanding that the model carries both a proven effectiveness and a proven tendency, when controls weaken, to drift toward abuse and concealment.

Why did Britain call these conflicts emergencies rather than wars?

The vocabulary was deliberate. Calling Malaya and Kenya emergencies rather than wars served practical purposes, including allowing commercial enterprises to retain insurance coverage that a declared war would have voided. More importantly, by denying the insurgents the status of combatants and labelling them bandits or terrorists, the colonial state freed itself from the legal architecture of war and governed instead through emergency regulations of its own making. This preference for a deniable category of conflict below the threshold of declared war later reappeared in the covert doctrines of modern states.

What happened in Aden, and what did it teach about intelligence?

Aden, in southern Arabia, faced an insurgency after 1963 driven by Arab nationalist movements. The Aden emergency is remembered in intelligence history because the local Special Branch, the very organization the Malayan model placed at the centre of any successful campaign, was systematically penetrated and then destroyed, with its officers identified and assassinated. The lesson was the inverse of Malaya. Where Malaya proved what a well-protected Special Branch could achieve, Aden proved how catastrophic it was to lose one, and how an insurgency that understood the centrality of intelligence could win by destroying the other side’s ability to collect it.

How does India’s colonial intelligence inheritance compare with other countries?

The colonial counter-insurgency doctrine influenced security services well beyond the former British Empire. American counter-insurgency thinking drew heavily on the British colonial campaigns, and the logic of intelligence-led targeting is recognizable in the later American drone campaign. Other intelligence traditions, including the Israeli and the Soviet, developed comparable doctrines of leadership targeting from their own histories. India’s distinctiveness is not that it practises this kind of covert action but that its institutional culture descends unusually directly from the specific colonial machine that Britain built and left behind.

Did India consciously choose colonial methods, or did it simply inherit them?

Both readings have support, and the most defensible position combines them. The initial inheritance was genuinely organic, the unavoidable result of building a state under the crisis conditions of Partition from the only materials available. But the persistence of the colonial template over the following decades, its survival through changes of government, its deliberate use in new theatres, and its endorsement by professionals who knew its history, moved it from accident toward ratified choice. India inherited the machine by necessity and then chose to keep it because it judged that the machine performed.

When was RAW created, and was it a break from the colonial inheritance?

The Research and Analysis Wing was established in 1968 under R. N. Kao as a dedicated foreign intelligence service, created after the intelligence failures of the 1962 war with China and the 1965 war with Pakistan. It was modelled in part on foreign agencies and represented a genuine modernization. But it was not a clean break from the colonial line. RAW was carved out of the colonial-descended Intelligence Bureau, staffed in its early years by officers from that parent body, and it carried forward the operational culture of the organization it grew out of.

What is the single most important lesson of the colonial shadow wars for the present?

The most important lesson is that the colonial covert toolkit is both genuinely effective and genuinely dangerous, and that the two qualities are inseparable. The techniques of intelligence-led counter-insurgency worked at the narrow task of defeating armed movements, which is why they were inherited and retained. But the colonial record, from Kenya’s detention camps to the interrogation scandals of Aden, also shows what those same techniques produce when firm legal and political control is absent. Any state that inherits the power inherits the danger, and a mature state has to hold both in view at the same time.

What was the migrated archive, and why does it matter for understanding this history?

The migrated archive refers to the body of colonial records that the British administration removed from its colonies as they approached independence rather than handing them to the successor governments. As each territory neared the transfer of power, officials identified the most sensitive files, particularly those documenting the coercive and covert side of colonial rule, and either destroyed them or shipped them back to Britain to be held in secret. The existence of this hidden archive was not publicly confirmed for decades, and it emerged fully only when litigation by Kenyan claimants forced disclosure in the early twenty-first century. The migrated archive matters to this history for two reasons. First, it means that the documentary record inherited by successor states was deliberately incomplete, stripped of the evidence that would have shown most clearly how the colonial intelligence machine actually behaved. Second, it demonstrates that concealment was a built-in function of the colonial system rather than an afterthought, a habit of institutional self-protection that a successor service could absorb along with the machine’s operational methods.

Were these colonial methods unique to British intelligence, or did other powers use similar techniques?

The techniques were not unique to Britain, though the British codified them with particular thoroughness. Other colonial powers facing nationalist insurgencies developed broadly comparable repertoires of population control, informant networks, and the targeting of insurgent leadership, often with even less restraint. What distinguished the British case was the degree to which the experience was turned into formal, transmissible doctrine, written down by practitioners such as Kitson and taught in staff colleges to officers of many nationalities. Because that doctrine travelled, the British colonial template influenced security thinking well beyond the territories Britain had governed. The intelligence-led, leadership-targeting logic that ran through the colonial emergencies can be recognized in the counter-insurgency and counter-terrorism practice of several modern states, some of which arrived at it by inheritance and some by parallel invention. India’s distinctiveness is not that it uses these methods but that its intelligence culture descends so directly from the specific colonial machine the British built and left behind.