In this paper, a novel architecture, Baby, for robotic babies is proposed with a systems engineering design approach. A robotic baby is an autonomous learning system with minimal structures at the beginning of its life, aiming to gradually learn languages and actions from interactions with human parents and the world. Throughout the paper, the philosophy and the reasoning behind a robotic baby with a systems engineering design approach is discussed. With the architecture, system verification and validation are conducted, which shows convincing language skills in parsing, similar to observed human cognitive behaviors. A proof of concept demonstration involving an integration with a 3D printer is also presented. With preliminary results, the roadmap for further development and the positioning of the architecture are presented.