Analysis and prediction of railway accident risks using machine learning

1.   Introduction

The human brain is highly complex. Replication of its functions through laboratory tests and computer models is not always feasible. The use of animals in neuroscience research provides a model similar in complexity to the human brain and is necessary to further research advances. Non-human primates (NHPs) are extensively used as animal models for scientific research. An NHP brain has many similarities to a human brain in regards to size, connectivity, functional areas, and aging processes, making it an ideal research model. NHPs can be trained to perform tasks that allow researchers to evaluate cognition and behavior. Specifically in neurophysiological studies, NHPs are trained on cognitive tasks prior to collecting neurophysiological data. A well-trained animal is necessary to obtain sufficient experimental results. Therefore, optimizing the training method is fundamental to successful research involving NHPs.

However, training procedures are likely far from being optimized. Various experiments require physically restraining the NHP during training or collecting data, both for the nature of the data itself and for the safety of the personnel involved. The primate chair is a common restraint device that, with the right modifications, is suitable for a wide array of scientific experiments. However, the animal is required to maintain a fixed position in the chair throughout the training and its ability to move is reduced. Providing a more comfortable training environment ultimately reduces stress, potentially improving the animal's well-being, the speed of training, and the animal's performance. Here we present the details of a system to train animals in their home cage instead of the classic chair-restraint training.

Training primates without chair-restraint has been used for a variety of species including chimpanzees, baboons, and gorillas ^{[1,2,3,4,5,6,7]}, and also for bonnet macaques, marmosets, pigtail macaques, tufted capuchin monkeys, squirrel monkeys, lion-tailed macaques, long-tailed macaques, and mouse lemurs ^{[2,3,4,8,9,10,11,12,13,14,15,16,17]}. Several groups have also trained rhesus macaques without chair restraining the animal ^{[13,18,19,20,21,22,23,24,25,26,27,28,29,30]}. Most of these groups have provided a computer-based interactive environment interface where animals are individually or even group housed ^{[2,3,4,5,6,7,10,11,12,13,14,15,16,17,19,21,23,24,25,26,27,28,29,30,31,32,33,34,35,36]}. Overall, in-cage touch screen training has been useful to many experiments, such as those conducted by Srihasam et al. ^[37]. Similar to the training methods which used rhesus macaques, focusing on behavior and cognition using a touch screen within the animal's own home cage ^{[25,26,27,28]}, we have designed, built and successfully utilized a fully portable cage-mountable system to train NHPs and here we describe the technical specifications, construction, and operation of the system. This system has the potential to ease and expedite the behavioral training of NHPs on a variety of tasks by allowing the animal greater control over when and how long it chooses to work, being less disruptive to the monkey's social interactions, and presumably eliminating some of the stress found in chair training. Moreover, we present data collected during the behavioral training on a visual memory and change detection task, demonstrating the feasibility of this approach for training on cognitive tasks.

2.   Materials and Methods

The protocols for all experimental and behavioral procedures were approved by the Montana State University Institutional Animal Care and Use Committee. The in-cage training system described here was designed for training rhesus macaques, but may be utilized to train and test various species of NHPs (Figure 1). This system makes home cage training possible for all NHPs with a design allowing the system to be portable and mountable on the NHP's cage. Additionally, the training system is designed to be safe, robust, and suitable for animal operation in-cage.

Figure 1.  Detailed schematic of the in-cage training system.

DownLoad: Full-Size Img PowerPoint

2.1.   System Design

The system includes four components: (1) local control unit, (2) remote control unit, (3) animal interface, and (4) reward delivery system (Figure 1).

(1) Local Control Unit: includes a desktop computer controlling the behavioral paradigm using two software. The minimum requirements for the desktop computer included an INTEL Pentium or Core i2 Processor, 2 GB of memory (DDR3 RAM), and 2 VGA ports for display. The system also included a line print terminal (LPT) also known as a parallel port to trigger the pump for reward delivery, 1 serial port to control the pump, and 1 RJ-45 port. The minimum hardware requirements for building or purchasing the desktop computer for the local control unit are listed in Table 1. The local control unit was located within the animal research facility but outside of the room housing the rhesus macaques. The graphical representation of the training behavioral paradigm was sent from the local control unit to the animal interface inside the subject's home cage (Figure 2).

Table 1.  Minimum requirements of the in-cage training system.

Part Name	Minimum Requirement
CPU	INTEL Pentium or i3
RAM	2 GB DDR3
Graphics card	1 GB with 2 VGA port
Ports and interfaces	Includes 1 parallel port, 1 VGA port, 1 serial port, and 1 RJ-45
Touchscreen monitor	ELO 1739L open-frame touchscreen LCD monitor, 43.18 cm, 1280 × 1024
USB cable	USB 2.0 A to B cable
Speaker	Logitech plug & play 10 watt
Pump	NE-4500 double OEM syringe pump
Camera	Day/night D-link IP camera
Cage mounting frame	30.5 × 37.15 cm
Listed are the various parts of the in-cage training system and the minimum requirement for each part.

---

 | Show Table

DownLoad: CSV

Figure 2.  Photos of the in-cage training system.

DownLoad: Full-Size Img PowerPoint

We employed the Presentation software (Neurobehavioral Systems, Inc., Berkeley, CA) for the working memory task and Matlab Psychophysics Toolbox (The MathWorks, Inc., Natick, MA) for the change detection task to control the stimulus presentation, behavioral data acquisition and reward delivery. The various programming scripts used for the working memory task and change detection task are available upon request. Both toolboxes are available to download online and they are widely used in psychological and neurophysiological experiments.

(2) Animal Interface: includes a touchscreen monitor, a mounting frame, a speaker for auditory feedback, and a lever. The minimum requirements for the animal interface include an ELO 1739L open-frame touchscreen LCD monitor 17 inch with a 1280 × 1024 resolution (Elo Touch Solutions, Inc., Milpitas, CA), and a USB 2.0 A to B cable. The minimum requirements for the electrical and mechanical parts of the animal interface are listed in Table 1. The monitor is 4.90 × 36.80 × 30.48 cm in size, embedded in a mounting frame of 30.5 × 37.15 cm in size, which was designed to snugly fit the side panel of the primate's cage. The frame stayed on the cage during the week and was removed once a week for cleaning. The frame was light enough (approximately 16 kilograms) for a single person to easily mount and remove it. The frame was designed in a way that the animal did not need to reach outside the cage to access the monitor. The designed frame fitting the Primate Products cages is commercially available upon request. Tasks were designed in a way that required a specific touch answer from the animal in response to a visual stimulus. The touch position was recorded by the local control unit. In the attention task, a lever response was also used in addition to a touch response and these data were also recorded by the local control unit. The local control unit could then send feedback based on the animal's performance via a speaker. We used a speaker as part of the animal interface as well as a juice delivery pump as a reward system.

(3) Reward System: includes a syringe pump managed by the local control unit. When the trial was correct, the local control unit triggered the reward system via a TTL pulse through a parallel port. Once the pump was triggered, it delivered a user defined juice amount to the subject. The reward system allowed the reward duration or the number of rewards to be set via the SyringePumpPro application (New Era Pump Systems, Inc., Farmingdale, NY) in the local control unit. We used a NE-4500 double OEM syringe pump. As mentioned above, in addition to the juice reward the animal could receive auditory feedback. Figure 2 shows the local control unit, animal interface, and the reward system; the minimum requirements for the monitoring and reward system are listed in Table 1.

(4) Remote Control Unit: includes a camera and a remote desktop computer. We used a night vision capable D-Link IP-camera (D-Link Systems, Inc, Fountain Valley, CA) to screen the subject's activity during the experiment. The camera was accessible over the internet to the remote control unit. This arrangement provided the possibility of monitoring the entire system remotely when the experimenter was not physically present in the animals' vivarium. The remote control unit could also remotely manage the experiment by accessing the local control unit. The subject's screen, the reward settings, and the behavioral paradigm could all be monitored and manipulated via the remote control unit.

2.2.   Behavioral Paradigms

The in-cage training system was designed to allow the subject to have his own self-paced engagement with the task. The animal was in the same room with other monkeys but was separated into his own home cage for training. While training the subject, the system was turned on in the morning and remained on throughout the day, then turned off in the evening. This allowed the subject to have control over when and how long to work throughout the day and to take breaks on his own time. The subject worked five days a week, with two vacation days per week. Throughout the work days the subject's access to water was limited to the juice he earned performing the task. If the animal chose not to work he would receive water instead of juice at the end of the day. This water restriction helped enhance the animal's motivation to perform the task, however, later during the training phase, the animal usually preferred performing the task and receiving juice, even in the presence of full water access. We tested the system by training a rhesus monkey in two behavioral paradigms:

Delayed Match to Sample (DMS) Task: DMS is an object working memory task. In this task the animal has to remember an object throughout a delay and choose the same object among multiple distractors after the delay period (Figure 3). The DMS task can be a time consuming and challenging task for NHPs. We broke down the DMS task into several steps to train the rhesus macaque in his home cage. In the first stage of training we focused on encouraging the subject to touch the touchscreen monitor. A sample image that encompassed the entire screen was presented as the target area and by touching anywhere on the screen, the subject earned a 4 mL juice reward per correct trial. After the subject's performance was consistently 85% correct, the image was shrunk by approximately 20%. This process was continued until the sample image size was reduced to one square inch on the touchscreen. To verify that the subject was looking at the sample image and not just the center of the screen, the second stage of training involved moving the sample image to a new screen location for each new trial. Throughout all trials until this point, the same image was used each day for each trial, with the goal of keeping all experimental factors consistent except for the specific behavioral task. After the subject was proficient with the moving sample image, the match to sample task was introduced. This third stage of training consisted of an initially presented sample image which the subject touched, followed by two target images; one of the target images was the same as the initial sample image and the other target image was a distracter image. To perform a correct trial, the subject had to select the target image that matched the initial sample image. To discourage the subject from being impatient and randomly touching the screen, and to encourage the subject to focus on deliberately touching the target, preferably with only one finger, a punishment was introduced in which an incorrect trial resulted in a three second inter-trial pause. After the subject mastered the match to sample stage, a delay was introduced between the presentation of the sample image and the two target images. The delay started at 100 ms and eventually escalated to a 2 second delay. After learning how to maintain the object information throughout a 2 second delay, new images were introduced to teach the subject how to generalize the DMS rule. After proficiency with a certain pair of images (performance rate 85%) a new pair of images was used. The subject became familiar with approximately 39 different images, generalizing the DMS rule. The training process was completed after 100 training sessions.

Figure 3.  Delayed match-to-sample task.

DownLoad: Full-Size Img PowerPoint

Change Detection Task: We used the same in-cage system to also train the animal with a change detection task (Figure 4). In this task the animal monitors a visual stimulus to detect a temporary contrast change. Again, the change detection task was broken down into several steps to train the rhesus macaque in his home cage. The first stage involved the subject learning how to press the lever. The subject had to press down the lever for a set amount of time in order to receive a juice reward. It occurred naturally by introducing a new object (the lever) to the curious animal's environment. After the subject learned how to sufficiently depress the lever, a visual target was introduced (a red dot) and the subject had to depress the lever and touch the target while keeping the lever pressed. After the target was touched, a visual stimulus (Gabor grating) would appear onscreen. The animal had to hold the lever for the duration of the stimulus. The stimulus duration was then gradually increased. Once the subject learned how to keep the lever pressed while maintaining its focus to detect when the stimulus turns off, then the "blink detection" part was added. In blink trials the stimulus would turn off and the subject would release the lever and receive the juice but then the stimulus would reappear. We gradually reduced the blink time to 100 ms and the subject had to release the lever quickly after the stimulus change in order to receive a juice reward. The quick release of the lever was the key to trace whether the animal was detecting the change. Once the subject was able to detect a changing Gabor, we gradually introduced variability in the location of the stimulus and the time of the change. To ensure that the subject was validly responding to the change, a no change condition was added to the task. For the no change trial, the subject had to press the lever, touch the target on the monitor, and keep the lever depressed for the duration of a non-changing stimulus in order to receive a juice reward. The ultimate goal was to detect a "contrast change". Therefore, once the animal was trained on detecting a 100 ms blink (100% change in contrast), then the duration of stimulus change (100 ms) was kept constant and the animal was gradually trained to detect smaller and smaller changes in the stimulus contrast.

Figure 4.  The change detection task consisted of change and no-change trials.

DownLoad: Full-Size Img PowerPoint

3.   Results

Training the object working memory task took about 100 training sessions. The training goal for the animal is to be able to generalize the rule to a novel object. Figure 5A shows the animal's ability to maintain object information throughout a delay period for two different objects early in training (day 17). At the start of the training session, the animal chose object A more often than object B regardless of which object was the sample. This bias decreased over the course of the training session and the animal gradually improved his performance for object B. This performance improvement showed the animal's ability to learn new objects. The animal's ability to generalize the rule is shown in Figure 5B. Later during the training (day 34), a new pair of objects were introduced and the animal was capable of maintaining both objects in his working memory from the start of the session.

Figure 5.  Early in training, a novel image results in low performance while later in training, a novel image results in immediate high performance.

DownLoad: Full-Size Img PowerPoint

Training was completed for the change detection task after 43 training sessions. The goal for the animal is to report the change by releasing the lever in response to a change in the visual stimulus. Figure 6A shows the animal's release time relative to the stimulus change early in training (day 16). At this point, the animal's release time did not closely match the stimulus change time, indicating that the animal had not yet mastered the task. Figure 6B shows the animal's performance later in training. The animal's release time more reliably followed the stimulus change time, showing that the animal was following the task rule. Figure 6C illustrates the animal's overall performance for an early vs. late day of training, showing a performance improvement as the training progressed.

Figure 6.  Early in training, release time is not dependent on the time of the stimulus change, and performance remains unchanged during a single training session, whereas later in training, release time reflects time of change and performance improves over a single training session.

DownLoad: Full-Size Img PowerPoint

The change detection task measures the animal's sensitivity to changes in a sensory signal (visual stimulus blink). After the animal was trained to detect a blink for the duration of 100 ms, we reduced the total signal change by keeping the blink duration constant and varying the magnitude of the luminance change. The animal performed well for the 100% contrast change condition (stimulus completely disappeared). To cover the dynamic range of the animal's performance the contrast change varied between 5%-65%. Figure 7A shows that the animal's performance depended on the contrast change, indicating that the animal was following the visual signal. The animal's performance gradually improved over time (Figure 7B), showing that the training stages enabled the animal to learn the task.

Figure 7.  Performance depends on the % contrast change.

DownLoad: Full-Size Img PowerPoint

4.   Conclusion

It is imperative to provide a low stress environment to enhance learning ^[38]. The ability to train NHPs in their own home cage could potentially expedite training and improve the animal's quality of life. Here we described the system we designed and used to successfully train an NHP on a change detection and a working memory task. We observed that the animal's motivation to perform these tasks was drastically higher compared to our previous experience of training other animals on similar tasks using a primate chair. This heightened motivation was also associated with faster training and higher performance. Moreover, once the animal was more familiar with the task they chose to perform the task even without water restriction. Rhesus monkeys are highly intelligent animals and a huge part of their daily care is providing them with sufficient mental activity and enrichment. Moving the training to the animal's cage not only expedited the training, it provided a great repertoire of behavioral enrichment throughout the day available at the animal's discretion.

The main impediment to exclusively using in-cage training is the need to track the eye position in most visual tasks. Eye tracking systems usually require the head to be stationary. Other groups have successfully used face masks to restrict the animal's head movement, potentially enabling tracking of their eye movements in their home cage ^{[39,40,41,42,43,44]}. Training the animal to use a face mask while performing behavioral tasks could drastically change the set of behavioral paradigms that these animals can learn in their home cage. If successful, this addition of eye tracking to this system could move most of the behavioral training to the animal's home cage. Ultimately once wireless electrophysiological recording devices are improved, recording the animal's behavioral and neural responses in more natural environments will be possible.

Acknowledgements

The work was supported by MSU start-up fund, Whitehall 2014-5-18, NIH R01EY026924, and NSF1439221 and 1632738 grants to BN.

Conflict of interest

All authors declare no conflicts of interest in this paper.