A project funded by the Department of Homeland Security promises to give security researchers a new way to kill botnets and targeted malware attacks before they infect computers.