• CUDA is a low-level, closed-source API that allows software to interact with NVIDIA GPUs.
• CUDA is NVIDIA's main moat, giving it an edge over other GPUs.
• Synergy of hardware and software, as well as a monopoly on CUDA.
• NVIDIA introduced CUDA in 2006, which contributed to the development of the industry.
• Alternative open standards/abstraction layer that can break monopoly.
• Specialized hardware such as Google's TPUs may become more popular than general purpose GPUs.
• CUDA is CPU bound, which may cause problems in the future.