What is a systematic way to efficiently apply a wide spectrum of advanced ML programs to industrial scale problems, using Big Models (up to 100s of billions of parameters) on Big Data (up to terabytes or petabytes)? Modern parallelization strategies employ fine-grained operations and scheduling beyond the classic bulk-synchronous processing paradigm popularized by MapReduce, or even specialized graph-based execution that relies on graph representations of ML programs. The variety of approaches tends to pull systems and algorithms design in different directions, and it remains difficult to find a universal platform applicable to a wide range of ML programs at scale. We propose a general-purpose framework that systematically addresses data-and model-parallel challenges in large-scale ML, by observing that many ML programs are fundamentally optimization-centric and admit error-tolerant, iterative-convergent algorithmic solutions. This presents unique opportunities for an integrative system design, such as bounded-error network synchronization and dynamic scheduling based on ML program structure. We demonstrate the efficacy of these system designs versus well-known implementations of modern ML algorithms, allowing ML programs to run in much less time and at considerably larger model sizes, even on modestly-sized compute clusters.

BackgroundHuman umbilical cord blood (UCB)-derived mesenchymal stem cells (MSCs) attenuate hyperoxic neonatal lung injury primarily through anti-inflammatory effects. We hypothesized that intratracheal transplantation of human UCB-derived MSCs could attenuate Escherichia coli (E. coli)-induced acute lung injury (ALI) in mice by suppressing the inflammatory response.MethodsEight-week-old male ICR mice were randomized to control or ALI groups. ALI was induced by intratracheal E. coli instillation. Three-hours after E. coli instillation, MSCs, fibroblasts or phosphate-buffered saline were intratracheally administered randomly and survival was analyzed for 7 days post-injury. Lung histology including injury scores, myeloperoxidase (MPO) activity, and protein levels of interleukin (IL)-1α, IL-1β, IL-6, tumor necrosis factor (TNF)-α, and macrophage inflammatory protein (MIP)-2 as well as the wet-dry lung ratio and bacterial counts from blood and bronchoalveolar lavage (BAL) were evaluated at 1, 3, and 7 days post-injury. Levels of inflammatory cytokines in the lung were also profiled using protein macroarrays at day 3 post-injury which showed peak inflammation.ResultsMSC transplantation increased survival and attenuated lung injuries in ALI mice, as evidenced by decreased injury scores on day 3 post-injury and reduced lung inflammation including increased MPO activity and protein levels of IL-1α, IL-1β, IL-6, TNF-α, and MIP-2 on day 3 and 7 post-injury. Inflammatory cytokine profiles in the lungs at day 3 post-injury were attenuated by MSC transplantation. MSCs also reduced the elevated lung water content at day 3 post-injury and bacterial counts in blood and BAL on day 7 post-injury.ConclusionsIntratracheal transplantation of UCB-derived MSCs attenuates E. coli-induced ALI primarily by down-modulating the inflammatory process and enhancing bacterial clearance.

The molecular function of the cellular prion protein (PrPC) and the mechanism by which it may contribute to neurotoxicity in prion diseases and Alzheimer's disease are only partially understood. Mouse neuroblastoma Neuro2a cells and, more recently, C2C12 myocytes and myotubes have emerged as popular models for investigating the cellular biology of PrP. Mouse epithelial NMuMG cells might become attractive models for studying the possible involvement of PrP in a morphogenetic program underlying epithelial-to-mesenchymal transitions. Here we describe the generation of PrP knockout clones from these cell lines using CRISPR-Cas9 knockout technology. More specifically, knockout clones were generated with two separate guide RNAs targeting recognition sites on opposite strands within the first hundred nucleotides of the Prnp coding sequence. Several PrP knockout clones were isolated and genomic insertions and deletions near the CRISPR-target sites were characterized. Subsequently, deep quantitative global proteome analyses that recorded the relative abundance of>3000 proteins (data deposited to ProteomeXchange Consortium) were undertaken to begin to characterize the molecular consequences of PrP deficiency. The levels of ∼120 proteins were shown to reproducibly correlate with the presence or absence of PrP, with most of these proteins belonging to extracellular components, cell junctions or the cytoskeleton.

In the yeast two-hybrid screening, we have isolated a cDNA clone from a human heart library using Nck Src homology 3 (SH3) domains as bait. The full-length cDNA, which encoded 722 amino acids, was identified as a VIP54-related gene containing an SH3 domain, prolinerich motifs, a serine/threonine-rich region, and a long C-terminal hydrophobic region. We refer to this protein as SPIN90 (SH3 Protein Interacting with Nck, 90 kDa). The amino acid sequence of the SH3 domain has the highest homology with those of Fyn, Yes, and c-Src. SPIN90 was broadly expressed in human tissues; in particular, it was highly expressed in heart, brain, and skeletal muscle, and its expression was developmentally regulated during cardiac myocyte differentiation. SPIN90 is able to bind to the first and third SH3 domains of Nck, in vitro, and is colocalized with Nck at sarcomere Z-discs within cardiac myocytes. Moreover, treatment with antisera raised against SPIN90 disrupted sarcomere structure, suggesting that this protein may play an important role in the maintenance of sarcomere structure and/or in the assembly of myofibrils into sarcomeres.

This study reports a low‐temperature processable, resistive switching (RS) device based on an inorganic–organic hybrid perovskite, i.e., methylammonium lead iodide (CH3NH3PbI3 or MAPbI3) via a fast deposition–crystallization method, as the multifunctional insulator layer to form metal/insulator/metal structure in which Al and p+‐Si wafer are used as the top and the bottom metal electrodes, respectively. The MAPbI3‐RS device shows acceptable RS characteristics with a switching window of 103 at a low voltage region (≈5 V), a stable endurance during 200 cycles, and a high retention for a prolonged time at 104 s. The operation mechanism of the MAPbI3‐RS device is based on ion (simultaneously vacancy) migration, especially iodine ions, which is analogous to that of oxygen ions in the conventional oxide‐based RS devices, confirmed through X‐ray photoelectron spectroscopy and energy‐dispersive X‐ray spectroscopy measurements. Furthermore, unusual multiresistance states are achieved from the MAPbI3‐RS device under light illumination due to the photosensitivity of MAPbI3.

We evaluated the inhibitory effects of components from the root of Glycyrrhiza uralensis (G. uralensis) on aldose reductase (AR) and sorbitol formation in rat lenses with high levels of glucose as part of our ongoing search of natural sources for therapeutic and preventive agents for diabetic complications. In order to identify the bioactive components of G. uralensis, 5 prenylated flavonoids (semilicoisoflavone B, 7-O-methylluteone, dehydroglyasperin C, dehydroglyasperin D, and isoangustone A), three flavonoids (liquiritigenin, isoliquiritigenin, and licochalcone A), and two triterpenoids (glycyrrhizin and glycyrrhetinic acid) were isolated; their chemical structures were then elucidated on the basis of spectroscopic evidence and comparison with published data. The anti-diabetic complication activities of 10 G. uralensis-derived components were investigated via inhibitory assays using rat lens AR (rAR) and human recombinant AR (rhAR). From the 10 isolated compounds, semilicoisoflavone B showed the most potent inhibition, with the IC 50 values of rAR and rhAR at 1.8 and 10.6 m mM, respectively. In the kinetic analyses using Lineweaver-Burk plots of 1/velocity and 1/concentration of substrate, semilicoisoflavone B showed noncompetitive inhibition against rhAR. The results clearly indicated that the presence of a g g,g g-dimethylchromene ring is partly responsible for the AR inhibitory activity of isoprenoid-type flavonoids. Further, semilicoisoflavone B inhibited sorbitol formation of rat lens incubated with a high concentration of glucose, indicating that this compound may be effective for preventing osmotic stress in hyperglycemia.

Licorice extracts are known to exhibit anti-carcinogenic activities. However, chronic licorice consumption can lead to serious side effects due to the presence of considerable quantities of glycyrrhizin, which causes severe hypokalaemia and hypertension. In the present study, we evaluated the effects of a hexane -ethanol extract of Glycyrrhiza uralensis (HEGU), which lacks glycyrrhizin, on the metastatic characteristics of DU145 prostate cancer cells. HEGU inhibited basal and epidermal growth factor-induced cell migration, invasion and adhesion in a dose-dependent fashion. HEGU significantly suppressed the secretion and activation of the matrix metalloproteinase (MMP)-2 and MMP-9. The secretion of tissue inhibitor of metalloproteinase (TIMP)-1 was reduced, but that of TIMP-2 was increased in HEGU-treated cells. HEGU reduced the protein levels of integrin-a2, the intercellular adhesion molecule, and the vascular cell adhesion molecule. An active fraction of HEGU was separated via column chromatography, and the structure of the active component, licoricidin, was identified via 1 H NMR and 13 C NMR. The treatment of DU145 cells with licoricidin induced a reduction in cell migration and the secretion of MMP-9, TIMP-1, urokinase-type plasminogen activator and vascular endothelial growth factor, as well as in the expression of adhesion molecules. These results indicate that HEGU, which contains licoricidin, is a potent anti-metastatic agent, which can markedly inhibit the metastatic and invasive capacity of malignant prostate cancer cells. The observed reductions in the activation of proteases and the levels of adhesion molecules may constitute a component of the mechanisms by which HEGU inhibits the migration and adhesion of prostate cancer cells.

The aim of this study was to investigate the relationship between survival and incidence of bronchopulmonary dysplasia (BPD) in extremely premature infants, and identify clinical factors responsible for this association. Medical records of 350 infants at 23–26 weeks gestation from 2000 to 2005 (period I, n = 137) and 2006 to 2010 (period II, n = 213) were retrospectively reviewed. The infants were stratified into 23–24 and 25–26 weeks gestation, and the survival, BPD incidence, and clinical characteristics were analyzed. BPD was defined as oxygen dependency at 36 weeks postmenstrual age. The overall survival rate was significantly improved in period II compared to period I (80.3% vs. 70.0%, respectively; P = 0.028), especially in infants at 23–24 weeks gestation (73.9% vs. 47.4%, respectively; P = 0.001). The BPD incidence in survivors during period II (55.0%) was significantly decreased compared to period I (67.7%; P = 0.042), especially at 25–26 weeks gestation (41.7% vs. 62.3%, respectively; P = 0.008). Significantly improved survival at 23–24 weeks gestation was associated with a higher antenatal steroid use and an improved 5-minute Apgar score. A significant decrease in BPD incidence at 25–26 weeks gestation was associated with early extubation, prolonged use of less invasive continuous positive airway pressure, and reduced supplemental oxygen. Improved perinatal and neonatal care can simultaneously lead to improved survival and decreased BPD incidence in extremely premature infants.