This paper proposes a method to adapt robot behaviors toward user's perception by human teaching. Human-friendly robotic system should be able to understand the fuzzy linguistic information based on the user's guidance and the environmental conditions. The contextual meaning of fuzzy linguistic information depends on the conditions of the environment. Therefore, user's perception is acquired to evaluate the fuzzy linguistic information in user commands based on fuzzy voice feedback. The primitive behaviors are evaluated by behavior evaluation network (BEN). Feedback evaluation system (FES) is introduced to evaluate the user feedback to correct the robot's perception by adapting the BEN. This yields the adaptation of the system for understanding fuzzy linguistic information toward the corresponding environment. A situation of cooperative rearrangement of user's working space is simulated to illustrate the system. This is demonstrated by using a PA-10 robot manipulator.