I am a Senior Engineer in Performance Architecture at Samsung Semiconductor in San Jose, California. I work on our hardware performance simulator, and I study how trends in large language models (LLMs) change hardware metrics, so that those trends can drive architectural decisions for next-generation AI inference hardware.
My work spans computer architecture, memory systems, and hardware/software co-design, applied to AI inference and privacy-preserving computing.
Before Samsung, I was a Scientist at Duality Technologies (2024–2026). There I designed and implemented components of TREBUCHET, a $15M DARPA DPRIVE effort (2021–2025) that built a custom 12 nm fully homomorphic encryption (FHE) accelerator ASIC for encrypted machine and deep learning, and I was Technical Lead for ARPA-H SHARE (Sharing Data for Rapid Collaboration on Encrypted Data), a privacy-preserving platform for healthcare collaboration built with ICF and Dana-Farber Cancer Institute.
I received my Ph.D. in Computer Science from the University of Utah in 2024, advised by Prof. Rajeev Balasubramonian in the Utah Arch Research Group. My thesis was on accelerating modern cryptography, with a focus on data movement. During my Ph.D. I was a research co-op at NVIDIA Research (2022) and AMD Research (2020). I received my B.Tech. from IIT Gandhinagar in 2017.
News
- Joined Samsung Semiconductor in San Jose as a Senior Engineer, Performance Architecture.
- Served on the Technical Program Committees of IEEE HPCA 2026, IEEE ISPASS 2026, IEEE/ACM ISCA 2026 and IEEE/ACM MICRO 2026; joined the IEEE/ACM ISCA 2027 Technical Program Committee.
- Our paper “Accelerating FHE to Enable Privacy-Preserving Deep Learning” (Duality Technologies, USC ISI and NYU) appeared at GOMACTech 2025, the U.S. Government Microcircuit Applications & Critical Technology Conference.
- Joined Duality Technologies as a Scientist, working on TREBUCHET, a 12 nm FHE accelerator ASIC under DARPA DPRIVE.
- Received my Ph.D. in Computer Science from the University of Utah.
- “Hyena: Balancing Packing, Reuse, and Rotations for Encrypted Inference” appeared at the IEEE Symposium on Security and Privacy (S&P) 2024.
Show older newsHide older news
- “HyGain: High-Performance, Energy-Efficient Hybrid Gain Cell-Based Cache Hierarchy” published in ACM Transactions on Architecture and Code Optimization.
- “XCRYPT: Accelerating Lattice-Based Cryptography with Memristor Crossbar Arrays” published in IEEE Micro.
- Joined NVIDIA Research as a co-op. Project: Homomorphic Encryption at Modern GPU Datacenter Scale.
- Our work on homomorphic-encryption-based CNN inference, “EPIC: Efficient Packing for Inference using Cheetah,” appeared at the 6th Workshop on Cognitive Architectures, held with HPCA 2022.
- Our team was selected as a finalist in Samsung’s Open Innovation Contest for AxDIMM Technology.
- “CANDLES: Channel-Aware Novel Dataflow-Microarchitecture Co-Design for Low Energy Sparse Neural Network Acceleration” accepted at HPCA 2022.
- Blog post: “Post Quantum Cryptography,” ACM SIGARCH Computer Architecture Today.
- Started a collaboration with Prof. Elaine Shi (CMU) and Xiong Fan (Rutgers University) on acceleration of post-quantum cryptography.
- Started a collaboration with Siddhartha Chhabra (Intel) on efficient memory integrity verification.
- CASA, a support initiative for computer architecture students, went live; I was a founding member and served on its steering committee.
- Teaching mentor for CS/ECE 6810 Computer Architecture (Fall 2020).
- Joined AMD Research as a co-op. Project: Processing-in-Memory.
- Presented “Efficacy of Statistical Sampling on Contemporary Workloads: The Case of SPEC CPU2017” at IISWC 2019 in Orlando.
- Started my Ph.D. at the University of Utah.
- Presented “Memory Centric Characterization and Analysis of SPEC CPU2017 Suite” at ICPE 2019 in Mumbai.
- “PANE: Pluggable Asynchronous Network-on-Chip Simulator” published in ACM JETC; the simulator is open source.
- Joined IIT Gandhinagar (later Ashoka University) as a Junior Research Fellow with Prof. Manu Awasthi.
- Joined Hexagon Capability Center India, Hyderabad, as a Software Analyst.
- Graduated with a B.Tech. from the Indian Institute of Technology Gandhinagar.
Publications
Conference and journal papers
-
IEEE S&P2024
-
IEEE Micro2023
-
ACM TACO2023
-
IEEE HPCA2022
-
IEEE IISWC2019
Efficacy of Statistical Sampling on Contemporary Workloads: The Case of SPEC CPU2017
IEEE International Symposium on Workload Characterization (IISWC), 2019
Traces of the simulation points are available; see Software.
-
ICPE2019
-
ACM JETC2019
Government conference papers
-
GOMACTech2025
Accelerating FHE to Enable Privacy-Preserving Deep Learning
Government Microcircuit Applications & Critical Technology Conference (GOMACTech), Pasadena, CA, March 2025, paper 37.2
Workshop papers and other writing
-
CogArch2022
EPIC: Efficient Packing for Inference using Cheetah
6th Workshop on Cognitive Architectures (CogArch), held with HPCA, 2022
-
Blog2021
Experience
-
Sep 2026 – Present
Senior Engineer, Performance Architecture
Samsung Semiconductor · San Jose, CA
- Work on the hardware performance simulator for next-generation AI inference hardware.
- Study how trends in large language models (LLMs) change hardware metrics, to drive architectural decisions.
-
Jul 2024 – May 2026
Scientist
TREBUCHET: 12 nm FHE accelerator ASIC · DARPA DPRIVE
A $15M DARPA effort (Apr 2021 – Nov 2025, completed) to build a custom 12 nm ASIC for homomorphic machine and deep learning, carried to a fully verified RTL implementation and top-level floorplan (176 mm², 1 GHz timing closure). The design includes a custom ISA, a microcode scheduler, and a node-array architecture, and was validated on encrypted CNN training and inference and AES transciphering.
My work: microcode generators for FHE kernels, kernel-to-hardware mapping, dataflow optimization, and a KeySwitching dataflow that improves data reuse; I also managed the technical collaboration with the NYU subcontractor team led by Prof. Brandon Reagen on simulator development.
Paper: “Accelerating FHE to Enable Privacy-Preserving Deep Learning,” GOMACTech 2025.
ARPA-H SHARE: Sharing Data for Rapid Collaboration on Encrypted Data
ARPA-H award to Duality Technologies (Scalable Solutions Office; up to $6.3M; started September 2024).
My role: Technical Lead. Privacy-preserving healthcare analytics across distributed patient-data owners, combining FHE, federated learning, differential privacy, and post-quantum cryptography, with ICF and Dana-Farber Cancer Institute.
-
May 2022 – Aug 2022
Research Co-op
NVIDIA Research · Homomorphic Encryption at Modern GPU Datacenter Scale
- Explored mappings of FHE kernels on multi-GPU architectures to maximize shared-memory reuse and reduce communication overheads.
- Evaluated acceleration opportunities using in-switch compute, NVSwitch, AllReduce/Broadcast/Transpose, and kernel fusion.
-
May 2020 – Aug 2020
Research Co-op
AMD Research · Processing-in-Memory
- Profiled BERT/NLP workloads to identify code segments suitable for processing-in-memory acceleration.
- Automated a PIM code-generation flow translating x86 instructions to PIM instructions, memory requests, and PIM/DRAM commands.
-
Aug 2019 – Jun 2024
Graduate Research Assistant
University of Utah · Utah Arch Research Group · Advisor: Prof. Rajeev Balasubramonian
- Ph.D. research on accelerating modern cryptography with a focus on data movement, memory systems, and hardware/software co-design.
- Accelerator and memory-system techniques for FHE, lattice-based cryptography, sparse neural networks, and cache/memory hierarchies.
Other Ph.D. research projectsHide projects
- Efficient Integrity Verification using Custom DIMM: reducing the cost of integrity verification in trusted environments with near-memory support.
- ZPU, Zero-Knowledge Proof Processing Units: high-throughput processing units for MSM/NTT kernels in zero-knowledge proofs.
- Reducing Expensive Key Movement in FHE using Processing-in-Memory: partitioning FHE kernels on a CPU-UPMEM model.
- Secure AI using Samsung’s AxDIMM (Oct 2021 – Jun 2022): finalist, Samsung Open Innovation Contest for AxDIMM Technology.
- Efficient Metadata for Memory Protection (Aug 2020 – Mar 2021).
- AMBOP, Adaptive Multiple Best Offset Prefetcher (Mar 2019 – Aug 2019).
Earlier positions
- Sep 2018 – Jun 2019Junior Research Fellow, Ashoka University: design of main memory architectures for next-generation datacenter servers, with Prof. Manu Awasthi
- Jan 2018 – Aug 2018Junior Research Fellow, IIT Gandhinagar: same project, with Prof. Manu Awasthi
- Aug 2017 – Dec 2017Software Analyst, Hexagon Capability Center India (HCCI), Hyderabad: Oracle Application Express (APEX) platform
Service and Recognition
- Technical Program Committee
- RecognitionFinalist, Samsung Open Innovation Contest for AxDIMM Technology, December 2021
- CommunityFounding Member and Steering Committee Member, Computer Architecture Student Association (CASA), 2020–2022
- TeachingTeaching Mentor, University of Utah: CS/ECE 6810 Computer Architecture (Fall 2020); CS 3810 Computer Organization (Spring 2022)
Software and Artifacts
-
PANE
A Pluggable Asynchronous Network-on-Chip simulator for modeling and analyzing synchronous, asynchronous, and mixed synchronous-asynchronous NoCs, with different topologies, routing algorithms, allocation and arbitration mechanisms, buffering schemes, and workloads. Code on GitHub · paper in ACM JETC 2019.
-
SPEC CPU2017 traces
Whole and regional Pinballs containing reproducible traces of the simulation points of the SPEC CPU2017 benchmarks; methodology in the IISWC 2019 paper. Email me for a copy.
Education
- 2019 – 2024
Ph.D., Computer Science, University of Utah
Thesis: accelerating modern cryptography, with a focus on data movement. Advisor: Prof. Rajeev Balasubramonian.
- 2013 – 2017
B.Tech., Indian Institute of Technology Gandhinagar
Major: Mechanical Engineering. Minor: Computer Science and Engineering.
Contact
Reach me at sarab@cs.utah.edu. I’d love to talk, about work or otherwise.