宝宝监护系统的市场调查:
'via Blog this'
Blog Archive
-
▼
2015
(226)
-
▼
July
(34)
- 宝宝监护系统的市场调查
- Baby Monitors Are Pricey, But Bring No Peace of Mi...
- Review: The Sproutling Baby Monitor - IEEE Spectrum
- Surprising facts about birth in the United States ...
- 武汉留学生创业园--留学生的港湾,创业者的家园-《楚天都市报-美国版》留创园人物巡展
- 利用可穿戴设备的语音交互,云知声看到了又一个做平台的机会 - 动点科技
- 云知声推出国内首款可穿戴式语音交互系统_网易科技
- Five Reporters React To Kapture, The Always-On Aud...
- HMMWeka
- Sproutling | CrunchBase
- Installing and Setting Up Sun Grid Engine on a Sin...
- Installing and Setting Up Sun Grid Engine on a Sin...
- Installation of Kaldi on Ubuntu 14.04
- 9 Surreal Places You Need To Visit Before You Die
- kaldi上使用gpu以及如何安装cuda
- Easy Installation of an Optimized Theano on Curren...
- Installing CUDA Toolkit 7.0 on Ubuntu 14.04 Linux ...
- How to Install Nvidia Driver 331.67 in Ubuntu 14.0...
- Music Audio Tempo Estimation and Beat Tracking in ...
- The Beginner's Guide to Using Protein Powder - Lif...
- Building latest Marsyas on Debian/Ubuntu - Marsyas...
- Burn a Disc Image from an ISO or IMG file in Windo...
- How do I zip/unzip on the unix command line? - Uni...
- 【干货】动态规划十问十答
- 名字真的会影响你的成功 很多人改名后收入翻倍(图) | www.wenxuecity.com
- NVIDIA DRIVERS Linux x64 (AMD64/EM64T) Display Driver
- Which GPU(s) to Get for Deep Learning: My Experien...
- A interesting website to learn Chinese
- TF-IDF, a single page tutorial
- Probabilistic Latent Semantic Indexing
- 科技英语小贴士
- A tutorial on MFCCs for Automatic Speech Recognition
- 10 Lifestyle Changes You Should Make In Your 30s
- 天使之城 Los Angeles 洛杉矶自助游全攻略_胡胡_新浪博客
-
▼
July
(34)
Tuesday, July 28, 2015
Baby Monitors Are Pricey, But Bring No Peace of Mind, Researcher Says
Baby Monitors Are Pricey, But Bring No Peace of Mind, Researcher Says: "Expensive Baby Monitors Give False Reassurance, Researcher Says"
http://www.livescience.com/48810-baby-monitors-pricey-false-reassurance-sids.html
'via Blog this'
http://www.livescience.com/48810-baby-monitors-pricey-false-reassurance-sids.html
'via Blog this'
Review: The Sproutling Baby Monitor - IEEE Spectrum
http://spectrum.ieee.org/geek-life/tools-toys/review-the-sproutling-baby-monitor
Review: The Sproutling Baby Monitor - IEEE Spectrum:
"Review: The Sproutling Baby Monitor
Keep tabs on your newborn with this smart ankle bracelet"
Review: The Sproutling Baby Monitor - IEEE Spectrum:
"Review: The Sproutling Baby Monitor
Keep tabs on your newborn with this smart ankle bracelet"
Wearable technology is currently primarily associated with two product categories—fitness trackers and smart watches. But wearables are beginning to show their potential in other areas as well. Ultimately, they are likely to enter into many facets of our daily existence. This article is the first in a series that will look at exemplars of wearables targeted at different stages of our lives.
We start at the beginning: infancy. Babies born this year could conceivably spend their entire lifetimes wearing an array of wireless sensors on their bodies, the minutiae of their daily lives measured, recorded, and analyzed. And the Sproutling baby monitor could be the first in that long line of devices.
As new fathers, Chris Bruce andMathew Spolin each had that moment of anxiety common to many parents: standing at the door of the nursery, worrying if the baby was breathing and wondering whether to go inside and check, just in case. In Bruce and Spolin’s case it helped inspire the founding of their San Francisco startup, Sproutling, and its eponymous product. In development for two years, Sproutling’s US $299 baby wearable was unveiled last August. (Spolin left the company this April.) A band worn on the ankle and encapsulated in medical-grade silicone, the wearable uses an optical heart-rate sensor to monitor the baby’s pulse, shining a light onto the skin and measuring the wavelength of returning light. A contactless sensor gauges the baby’s temperature. An accelerometer tracks the baby’s position and motion and can alert parents if the baby rolls over.
A base station doubles as a wireless charger, using magnetic resonance (the Alliance for Wireless Power’s Rezence wireless charging standard), to provide enough power to run the band for one to two days at a time. The base station is also equipped with additional sensors that audit the room’s temperature, humidity, light, and noise levels. Together, the wearable and base station gather up to 16 measurements a second, which are processed and used to advise the parent, who may be wondering: Is it too noisy? Has the temperature risen, making it uncomfortable for the baby?
Unlike with many fitness wearables, the actual numbers—how many decibels of noise, the baby’s temperature, and so on—are not displayed or charted for parents (although a ring of light on the base station does pulse at the rate of the baby’s heartbeat, as does an animated heart on the smartphone app). Instead, Sproutling’s algorithms convert the data into alerts for the parents only as needed, sending a push notification on a smartphone, say, if the baby’s temperature has suddenly spiked. “It’s not designed to give you graphs and numbers,” Spolin says. “It’s really to let you know when things are okay or when you should check on your child.”
Taking into account factors such as how much the baby slept earlier in the day, as well as the baby’s age and historical temperament, Sproutling’s machine learning algorithms can also predict how long the baby should sleep and when the baby might wake up. How accurate its predictions are is yet to be proved; Sproutling won’t start shipping until late July or August. “The more and more it’s used, and the more we learn about your child, the better it gets over time,” Bruce says. “We want to help parents get that sixth sense of what’s going on, to quantify patterns that parents can’t do themselves.”
The overarching objective is to reduce parental anxiety. “I’m building the stuff I wanted as a parent,” says Bruce, whose children are now 4 and 6. “We were looking at that antiquated baby monitor and trying to see: ‘Is she breathing? Did she roll over?’ Now we can tell you that yes, the baby’s heart is beating, and you can go to sleep.”
This article originally appeared in print as “Baby by the Numbers.”
'via Blog this'
武汉留学生创业园--留学生的港湾,创业者的家园-《楚天都市报-美国版》留创园人物巡展
http://www.wh-newstart.org/?thread-1952-1.html
武汉留学生创业园--留学生的港湾,创业者的家园-《楚天都市报-美国版》留创园人物巡展:
'via Blog this'
武汉留学生创业园--留学生的港湾,创业者的家园-《楚天都市报-美国版》留创园人物巡展:
《楚天都市报—美国版》:海归博士站在大数据的风口“等风来”
近两年,“大数据”在教育领域日益成为热点名词,和“在线教育”相呼应。几乎每家教育机构都在“拥抱”大数据,把大数据当作在激烈竞争中脱颖而出的秘密武器。
在武汉,一直钻研大数据的戴翰波手握“武器”,推出了连结线上线下教育的平台,利用大数据教中小学生学习英语。在激烈的市场竞争面前,他认为自己并不是去和业界巨头们竞争,去颠覆这个行业,而是做市场的补充,在细分市场中做到足够强大。
找到“风口”去创业
戴翰波是武汉慧人信息科技有限公司的创始人,也是武汉3551光谷人才、首批百名“创业先锋”之一。
对于创业初衷,戴翰波开玩笑说:“老跟别人玩多没意思,要自己玩玩。”
1970年出生的戴翰波,在湖北大学本科毕业后就留校任教,两年后选择去了新加波留学深造。从硕士念到博士,在与大数据研究打交道的过程中,他就盘算着要自己创业。
2010年在博士毕业期间,他在新加坡成为一个创业公司的合伙人。同时,他还在寻找自己创业的风口。
大数据背景下有很多种分支和选择,比如医疗、教育,主要是看怎样应用。曾经当老师的经历,很快让他瞄准教育行业,一番斟酌后选择了K12(中小学基础教育阶段)在线教育,这被行业看做是潜力无限的“金矿”。
据艾瑞咨询数据显示,2013年中国在线教育市场规模达839.7亿元,预计2014-2017年复合增速20%左右。其中,K12是增速最快的细分领域,占比将由2013年的7.4%提升至12.2%,达到211.5亿元。
在戴翰波看来,以学生为中心的教育,还包括了老师、家长,相当于一个市场有了三倍的容量。在这个细分行业中,还没有形成一个可以称霸的领头羊,“这就是创业者的风口”。
2011年,戴翰波回到武汉注册了公司。他表示,武汉创业、创新气氛浓厚,更是可以让创业者接地气的城市。
用大数据解决学生刚需
创业选择教育,戴翰波有很多对手,如百度、阿里巴巴、新东方等。他说:“我不和他们竞争,我是他们的补充。有的互联网公司上来就说要颠覆这个行业,结果没看见谁被颠覆,他自己先没了。”
2013年底,戴翰波推出“慧话宝”,围绕中小学生学习英语展开,武汉一小学率先试点使用。
通过平台,首先是英语老师可以实现备课、教学、课后管理以及培训提升,形成一个闭环。链条下一环节中心是学生,通过这个平台,完成老师布置的作业,还可学习英语歌曲,通过看国外电影纠正口音。
在戴翰波看来,这些都是基础性的,最重要的是平台背后的大数据。通过对学生行为数据进行诊断,老师可以了解到哪一个知识点是学生集中难点,依次帮助老师进行个性化教学。对于学生而言,则基于能力高低推送需要完成的训练任务,提高学习效率。
去年底,该平台推出“提分大挑战”板块,戴翰波试图通过这个提高学生能力的同时,增强学习信心和兴趣。
戴翰波说,如果用户观看几分钟就关掉了,以后再没看过,可能是学得非常好,也可能是学得不好,看不懂。与其他在线教育不同的是,在这个平台上,通过大数据,可以轻易找出学生的短板,有针对性的进行训练。甚至,可以从用户的英文发音,了解其的嘴巴是张大了还是小了,从而进行纠正。他形容,这是“对症下药”。
他打比方说,一个五年级的学生长期不及格,这个时候平台就会自动为他“降级”,通过做四年级的练习题,强化学习。在这个过程中,后台会根据学生实际情况,逐步提升听、说、读、写各项难度系数。
戴翰波说,未来大数据技术的应用将有利于个性化教育,标准化的学习内容由学生自己组织学习,学校和教师更多的是关注学生的个性化培养,教师由教学者逐渐转变为助学者。
创业路上不急于盈利
戴翰波认为,要做好线上教育,不仅需要掌握大数据技术、互联网思维,还必须了解传统教育行业,“需要找到学生、老师以及家长的痛点”。
他将慧话宝智能云口语学习平台落到线下,从免费试用推广到客户掏钱购买,去年底,已经进入到武汉近90所小学。“从传统的渠道采集数据,是了解这一个群体刚需的最好方式。”戴翰波说,大数据可以解决线上学习的问题,但目前,与其他行业的大数据相比,教育行业大数据目前数据量比较小,要走的路还很长。
不过,让戴翰波意外的是,去年竟有不少家长慕名前来购买服务。“他们都是在家长圈听别的学生家长介绍的。”这让他看到了“家长圈”的传播力。
为此,他一方面从网上取得反馈,另外请家长和老师提意见,“别人哪里用得不满意,我们毫无折扣地改正”,产品的不断迭代,正是一个前行的过程。
戴翰波说,当他还在公司盘算着这个月要烧多少钱时,他的博士同学们已开始在硅谷的谷歌或者脸谱,领着十多万美元的年薪享受生活。不过他并不着急。当他看着一拨拨刚毕业的大学生投身创业大潮,他也只是一个初创公司的老板,他也不着急。
当风投找上他是,他一样不着急。他认为,目前公司还没有完全进入轨道,评估价格很低,风投随便投入几十万元就能占比较大比例的股份,对公司不公平,还可能影响他的决策和公司未来的发展。
“距离盈利还有一段路要走。”戴翰波说,“不着急,我对项目有信心。这么多年,我有了一些积累,烧得起。”
戴翰波笑着说,自己已经找到了风口,剩下的就像那只猪一样站上去,等风来,然后被风吹上天。
在武汉,一直钻研大数据的戴翰波手握“武器”,推出了连结线上线下教育的平台,利用大数据教中小学生学习英语。在激烈的市场竞争面前,他认为自己并不是去和业界巨头们竞争,去颠覆这个行业,而是做市场的补充,在细分市场中做到足够强大。
找到“风口”去创业
戴翰波是武汉慧人信息科技有限公司的创始人,也是武汉3551光谷人才、首批百名“创业先锋”之一。
对于创业初衷,戴翰波开玩笑说:“老跟别人玩多没意思,要自己玩玩。”
1970年出生的戴翰波,在湖北大学本科毕业后就留校任教,两年后选择去了新加波留学深造。从硕士念到博士,在与大数据研究打交道的过程中,他就盘算着要自己创业。
2010年在博士毕业期间,他在新加坡成为一个创业公司的合伙人。同时,他还在寻找自己创业的风口。
大数据背景下有很多种分支和选择,比如医疗、教育,主要是看怎样应用。曾经当老师的经历,很快让他瞄准教育行业,一番斟酌后选择了K12(中小学基础教育阶段)在线教育,这被行业看做是潜力无限的“金矿”。
据艾瑞咨询数据显示,2013年中国在线教育市场规模达839.7亿元,预计2014-2017年复合增速20%左右。其中,K12是增速最快的细分领域,占比将由2013年的7.4%提升至12.2%,达到211.5亿元。
在戴翰波看来,以学生为中心的教育,还包括了老师、家长,相当于一个市场有了三倍的容量。在这个细分行业中,还没有形成一个可以称霸的领头羊,“这就是创业者的风口”。
2011年,戴翰波回到武汉注册了公司。他表示,武汉创业、创新气氛浓厚,更是可以让创业者接地气的城市。
用大数据解决学生刚需
创业选择教育,戴翰波有很多对手,如百度、阿里巴巴、新东方等。他说:“我不和他们竞争,我是他们的补充。有的互联网公司上来就说要颠覆这个行业,结果没看见谁被颠覆,他自己先没了。”
2013年底,戴翰波推出“慧话宝”,围绕中小学生学习英语展开,武汉一小学率先试点使用。
通过平台,首先是英语老师可以实现备课、教学、课后管理以及培训提升,形成一个闭环。链条下一环节中心是学生,通过这个平台,完成老师布置的作业,还可学习英语歌曲,通过看国外电影纠正口音。
在戴翰波看来,这些都是基础性的,最重要的是平台背后的大数据。通过对学生行为数据进行诊断,老师可以了解到哪一个知识点是学生集中难点,依次帮助老师进行个性化教学。对于学生而言,则基于能力高低推送需要完成的训练任务,提高学习效率。
去年底,该平台推出“提分大挑战”板块,戴翰波试图通过这个提高学生能力的同时,增强学习信心和兴趣。
戴翰波说,如果用户观看几分钟就关掉了,以后再没看过,可能是学得非常好,也可能是学得不好,看不懂。与其他在线教育不同的是,在这个平台上,通过大数据,可以轻易找出学生的短板,有针对性的进行训练。甚至,可以从用户的英文发音,了解其的嘴巴是张大了还是小了,从而进行纠正。他形容,这是“对症下药”。
他打比方说,一个五年级的学生长期不及格,这个时候平台就会自动为他“降级”,通过做四年级的练习题,强化学习。在这个过程中,后台会根据学生实际情况,逐步提升听、说、读、写各项难度系数。
戴翰波说,未来大数据技术的应用将有利于个性化教育,标准化的学习内容由学生自己组织学习,学校和教师更多的是关注学生的个性化培养,教师由教学者逐渐转变为助学者。
创业路上不急于盈利
戴翰波认为,要做好线上教育,不仅需要掌握大数据技术、互联网思维,还必须了解传统教育行业,“需要找到学生、老师以及家长的痛点”。
他将慧话宝智能云口语学习平台落到线下,从免费试用推广到客户掏钱购买,去年底,已经进入到武汉近90所小学。“从传统的渠道采集数据,是了解这一个群体刚需的最好方式。”戴翰波说,大数据可以解决线上学习的问题,但目前,与其他行业的大数据相比,教育行业大数据目前数据量比较小,要走的路还很长。
不过,让戴翰波意外的是,去年竟有不少家长慕名前来购买服务。“他们都是在家长圈听别的学生家长介绍的。”这让他看到了“家长圈”的传播力。
为此,他一方面从网上取得反馈,另外请家长和老师提意见,“别人哪里用得不满意,我们毫无折扣地改正”,产品的不断迭代,正是一个前行的过程。
戴翰波说,当他还在公司盘算着这个月要烧多少钱时,他的博士同学们已开始在硅谷的谷歌或者脸谱,领着十多万美元的年薪享受生活。不过他并不着急。当他看着一拨拨刚毕业的大学生投身创业大潮,他也只是一个初创公司的老板,他也不着急。
当风投找上他是,他一样不着急。他认为,目前公司还没有完全进入轨道,评估价格很低,风投随便投入几十万元就能占比较大比例的股份,对公司不公平,还可能影响他的决策和公司未来的发展。
“距离盈利还有一段路要走。”戴翰波说,“不着急,我对项目有信心。这么多年,我有了一些积累,烧得起。”
戴翰波笑着说,自己已经找到了风口,剩下的就像那只猪一样站上去,等风来,然后被风吹上天。
'via Blog this'
Five Reporters React To Kapture, The Always-On Audio Recording Watch ⚙ Co.Labs ⚙ code + community
Five Reporters React To Kapture, The Always-On Audio Recording Watch ⚙ Co.Labs ⚙ code + community: "This is obviously a pretty pointless product that will probably be a total dud, like most gadgets coming out of the wearable technology f"
'via Blog this'
'via Blog this'
Monday, July 27, 2015
Sunday, July 26, 2015
Friday, July 24, 2015
Installing and Setting Up Sun Grid Engine on a Single Multi-Core PC [tested on Ubuntu 16.04, 14.04, 12.04]
Note: this also works on:
Ubuntu 16.04 LTS,
tested on 05/25/2016
Linux s2 4.4.0-22-generic #40-Ubuntu SMP Thu May 12 22:03:46 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
Ubuntu 14.04 LTS
test on 05/24/2016, 07/24/2014
##########
ERROR FAQ:
How to solve the string conversion error:
Warning: Cannot convert string to type Pixmap
You can simply rely on the position on the GUI to make it right.
What if your submitted job is always in 'qw' status even there is enough slots:
Always use your pc's hostname to replace all the instance of "localhost" mentioned in the above documentation.
What is sge version in this testing?
Answer: 6.2u5-7.4
How to handle the connection error:
error: can't find connection
error: can't get configuration from qmaster -- backgrounding
Answer: ignore.
How to reconfigure:
To reconfigure the already installed after changing your hostname (for ubuntu in /etc/hostname) to match the one you got from running the above host command:
sudo dpkg-reconfigure gridengine-master
How to remove all SGE stuff to have a clean re-installation:
sudo apt-get purge gridengine-common gridengine-exec gridengine-client
Why there is only one job running in my SGE?
If you are the admin of SGE.
1) Type qmon
2) ==>Queue Control ==> Modify ===> General Configuration ===> Slots
put your CPU number there.
Note, the default value is 1.
% qstat -f
error: commlib error: got select error (Connection refused)
error: unable to send message to qmaster using port 6444 on host "<hostname>": got send error
%
When I upgrade ubuntu from 14.04 to 16.04, I got the above error.
My solution is to remove SGE and have a clean re-installation. (tested on 5/25/2016)
https://supcom.hgc.jp/english/utili_info/manual/faq.html
Reference:
[1] Note, the 90% contents of this post comes from:
Installing and Setting Up Sun Grid Engine on a Single Multi-Core PC | scidom:
[2]Howto set up SGE for CUDA devices? http://serverfault.com/questions/322073/howto-set-up-sge-for-cuda-devices
[3]
Ubuntu 16.04 LTS,
tested on 05/25/2016
Linux s2 4.4.0-22-generic #40-Ubuntu SMP Thu May 12 22:03:46 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
Ubuntu 14.04 LTS
test on 05/24/2016, 07/24/2014
Installing and Setting Up Sun Grid Engine on a Single Multi-Core PC
Introduction
I was on the phone the other day with a friend of mine. He told me that he wanted to execute his C program for several sets of input arguments. His was planning to use his quad-core workstation at work. He wanted to ensure that the four cores would remain busy until all the runs of the program had completed for the various sets of input arguments and that each core would run for exactly one set of arguments at a time.
His initial thought had been to make use of the “make” command. This solution would entail a makefile, which would be invoked by running “make -j4” in the directory where the makefile would reside. The “-j4″ option specifies that four jobs should run simultaneously, thus allocating a single job at a time to each of the four cores.
I wasn’t aware of such implementation of the “make” command. I found it elegant, although none of us dedicated the time to find out how the makefile should be written. My initial thought was to write a bash script so as to regulate the submission of jobs. However, the term “job scheduling” then came to my mind. It would be probably more time saving in the long run, more neat and it would offer better job supervision to employ a job scheduler.
The Load Sharing Facility (LSF) platform and Condor were the two job schedulers I knew from my work experience. My friend suggested the Son of Grid Engine (SGE). The obvious challenge was the installation and setting up of the job scheduler. There are numerous manuals, user guides, FAQs and forums explaining how to install SGE on a cluster. We have been inexperienced starters intending to use SGE to cover our individual computing needs on the basis of a single multic-core machine instead of a cluster. It turned out to be a cumbersome task for us to find coherent documentation for dummies to resolve the installation task at hand.
Before going any further with SGE, it is worth mentioning GNU Parallel, which is a shell tool for executing jobs in parallel in one or more computers. Parallel’s scope is somewhat different to SGE’s, since the former is not a fully fledged job scheduler. Nevertheless, Parallel is a lightweight tool, it is user-friendly, it handles job allocation to multiple cores of the same machine and it allows submission of multiple job arrays. In fact, my friend fulfilled his initial program execution request with Parallel. So, Parallel is an alternative functional tool for parallel job execution suiting the needs of an individual user.
In what follows, I will try to provide an overview on how to install and set up SGE on a single multi-core PC. As it usually happens, this post may not solve all the problems you might encounter during installation, although the intention has been to make it self-complete. It is the encounter of the exciting voyage of my friend and I, summoning our naive first-hand experience of tailoring the SGE installation to the modern reality of an individual user with a single multi-core machine.
The installation and setup instructions have been based on the Linux Mint Debian (LMDE) distribution and have been tested on Kubuntu 11.10. This guide is structured in three parts. The first part focuses on the installation, the second on setting up SGE and the third on testing SGE by means of elementary examples.
Part 1: Installation of SGE
To embark on the installation of the gridengine packages, run the following command on your terminal:
1
2
| sudo apt-get install \ gridengine-master gridengine- exec gridengine-common gridengine-qmon gridengine-client |
Instead, you can run the shorter, and perhaps more error-prone, command
1
| sudo apt-get install gridengine-* |
A pop-up window will appear within the terminal during installation, with title “Configuring gridengine-common”. A series of questions show up sequentially in this window:
- Question: “Configure SGE automatically?” Answer: highlight “<Yes>” and press “Enter”.
- Question: “SGE cell name:” Answer: type “default”, then press “Tab” to highlight “<Ok>” and press “Enter”.
Note here that you are free to choose any name you want for your SGE cell instead of “default”, such as “sge_cell” for example. If you alter the SGE cell name, you will have to subsequently set the SGE_CELL variable in your ~/.bashrc file accordingly (assuming that bash is your default shell). For instance, if you set the SGE cell name to be sge_cell, you will add the following line in your ~/.bashrc:1export
SGE_CELL=
"sge_cell"
Furthermore, you will need to add the above line of code in your /root/.bashrc file so that the SGE cell is also known to the root. It is advised that you leave the SGE cell name as it is, holding the “default” value. - Question: “SGE master hostname:” Answer: type “localhost”, then press “Tab” to highlight “<Ok>” and press “Enter”.
Instead of “localhost”, you can choose the hostname of your computer, which can by found by running the “hostname” command from the terminal:1hostname
After answering these three questions, the pop-up window closes and the installation continues on the terminal. If for any reason you need to reconfigure the gridengine-master package, you can do so by invoking the following command:
1
| sudo dpkg-reconfigure gridengine-master |
The installation of gridengine is now complete, yet this does not mean that you are necessarily ready to use SGE. First of all, check whether sge_qmaster and sge_execd are running by using the command
1
| ps aux | grep "sge" |
The output I got verified that sge_qmaster and sge_execd are running:
1
2
3
| sgeadmin 1310 0.0 0.1 135968 5376 ? Sl 13:41 0:00 /usr/lib/gridengine/sge_qmaster sgeadmin 1336 0.0 0.0 54760 1544 ? Sl 13:41 0:00 /usr/lib/gridengine/sge_execd 1000 3171 0.0 0.0 7780 860 pts/0 S+ 13:54 0:00 grep --colour=auto sge |
If this is not the case for you, then start up sge_qmaster and sge_execd by executing the following three commands:
1
2
3
| sudo su sge_qmaster sge_execd |
Once you ensure that sge_qmaster and sge_execd are running, try to start qmon, the graphical user interface (GUI) for the administration of SGE:
1
| sudo qmon |
It is likely that the qmon window will not load, but instead you will get an error message. This is what I got:
1
2
3
4
5
6
7
| Warning: Cannot convert string "-adobe-courier-medium-r-*--14-*-*-*-m-*-*-*" to type FontStruct Warning: Cannot convert string "-adobe-courier-bold-r-*--14-*-*-*-m-*-*-*" to type FontStruct Warning: Cannot convert string "-adobe-courier-medium-r-*--12-*-*-*-m-*-*-*" to type FontStruct X Error of failed request: BadName (named color or font does not exist) Major opcode of failed request: 45 (X_OpenFont) Serial number of failed request: 643 Current serial number in output stream: 654 |
The error message indicates that some fonts are missing. The package which contains the necessary fonts is called xfonts-75dpi. In my case, xfonts-75dpi was installed automatically alongside the installation of the gridengine packages. Nevertheless, I got the error message because the fonts were not loaded after their installation. So, I merely restarted my computer. After rebooting, the “sudo qmon” command loaded the qmon window. If xfonts-75dpi is not installed on your system, then install it using the following command and then reboot:
1
| sudo apt-get install xfonts-75dpi |
After having resolved any possible font-related issues “sudo qmon” should load the SGE admin window. If you let the window remain idle or if you try to press any of its buttons, such as “Job Control”, the most likely event will be the appearance of a message pop-up window with the text “cannot reach qmaster”. Click on the “Abort” button of the pop-up window to terminate qmon. Try also the qstat command, which in my case gave the following error message:
1
2
| error: commlib error: access denied (client IP resolved to host name "localhost". This is not identical to clients host name "russell") error: unable to contact qmaster using port 6444 on host "russell" |
It is useful to delve in the error message in conjunction with the /etc/hosts file of my system:
1
2
3
4
5
6
7
8
9
| 127.0.0.1 localhost 127.0.1.1 russell # The following lines are desirable for IPv6 capable hosts ::1 localhost ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters ff02::3 ip6-allhosts |
The hostname of my computer is “russell”. According to the error message, SGE set the client hostname to “russell”, whose LAN IP address is 127.0.1.1, while it set the client IP to 127.0.0.1, which is the LAN IP designated to the hostname “localhost”. To resolve this ambiguity, I changed the first two lines of my /etc/hosts so that both hostnames “localhost” and “russell” share the same LAN IP (as a word of warning, make a backup of your /etc/hosts file before making any changes to it). To be more specific, I deleted the second line and appended the “russell” hostname to the end of the first line. My /etc/hosts file thus became:
1
2
3
4
5
6
7
8
| 127.0.0.1 localhost russell # The following lines are desirable for IPv6 capable hosts ::1 localhost ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters ff02::3 ip6-allhosts |
Moreover, it is possible that your /etc/hosts file contains by default the string “localhost.localdomain” in the first line, for example as in
1
| 127.0.0.1 localhost localhost.localdomain russell |
If that’s the case, make sure you remove “localhost.localdomain” so that only “localhost” and your machine’s hostname (“russell” is my hostname), are tied to the LAN IP 127.0.0.1:
1
| 127.0.0.1 localhost russell |
You may restart sge_qmaster and sge_execd, although it is not advised given that you made a fundamental change to your system’s state by reconfiguring the association between IPs and hostnames in the /etc/hosts file. Instead, you are advised to restart your computer before you proceed any further. After rebooting, “qstat” and “sudo qmon” should run without returning any error messages.
Part 2: Setting up SGE
SGE is now (assumed to be) installed on your system and it needs to be set up before using it. To this end, it it will be demonstrated how to use qmon in order to initialize and thereafter administrate SGE.
- Firstly, run “sudo qmon” and click on the “User Configuration” button of the loaded qmon window. On the text box of the “User” tab, insert your username, let’s say “theodore” (without the double quotes), and then click on the “Add” button. As soon as you add yourself as an SGE user, the “User” tab of the user configuration window will look similar to the following snapshot:Click on the “Userset” tab and either create a new set of users or highlight an existing one. To follow up with my exemplified setup, highlight the existing set of users called “arusers” and press “Modify”. A new window pops-up. In the text box with title “User/Group”, type the username of the SGE user that you recently created (theodore) and press “Ok”. The snapshot below shows how the “Userset” tab of the user configuration window will look:Press “Done” to leave the user configuration window.
- Click on the “Host Configuration” button of the qmon window. On the text box of the “Submit Host” tab, insert the hostname, for example “localhost” (without the double quotes), and click on the “Add” button. This is a snapshot of the submit host tab of the host configuration panel:Select the “Execution Host” tab of the host configuration panel. Highlight one of the hosts, say the localhost, and click on the “Modify” button. A new window pops up. Select the “User Access” tab, then highlight one of the access list entries (for example arusers) and, after making sure that the “Allow Access” radio button is chosen, click on the red right arrow as demonstrated in the snapshot below:Click “Ok” to return to the host configuration panel. This is how the localhost entry in the execution host tab of the host configuration panel will look:Notice that the “Access” entry of the “Access Attributes” list has the value “arusers”, not “NONE”.
Finally, click on the “Queue Control” button of the qmon window. Press “Add” under the “Cluster Queues” tab. A new window loads. Type the name of your choice for the new queue in the text box with title “Queue Name” (“mainqueue” was chosen for the current example). Type also the hostname (for example localhost) in the text box with title “New Host/Hostgroup” and then click on the red left arrow so that the hostname is added to the hostlist of the queue. On the “User Access” tab of the current window, highlight one of the access list entries (for example arusers) and, after making sure that the “Allow Access” radio button is chosen, click on the red right arrow. The following snapshot shows a snapshot of the “User Access” tab:
Select the “General Configuration” tab of the current window. Change the following entries:
- The value of the “Processors” entry is by default set to “UNDEFINED”. Set it to be equal to the number of processors of your PC. I set it to 2, as I have a dual-core computer.
- Specify the “Shell”. By default, it is set to /bin/csh. I set it to /bin/bash, as I prefer to work on the bash shell.
- Specify the number of “Slots”, which is by default set to 1. Should you wish, you can define more slots than the number of cores and regulate the maximum number of concurrently running jobs retrospectively using the “-tc” option for job arrays. I chose to set the number of slots to be as many as the cores of my computer, that is 2.
This is how the general configuration tab of the queue control panel will look after the above changes:
Press “Ok” to leave the current window of the newly created queue, then click on “Done” to leave the queue control panel and finally click on the “Exit” button of the qmon window to exit qmon. SGE has been set up and is ready to be tested.
Part 3: Elementary Test Runs on SGE
As a matter of personal practice, I prefer to organize my submitted jobs with the help of wrapper scripts. Generally speaking, if the script containing the actual code is called scriptname.sh, I write another wrapper script called scriptname_qsub.sh which invokes qsub to submit scriptname.sh on SGE.
“Hello world” Test
To start with, submit a typical “hello world” bash script in order to check whether SGE works. This toy script simply echoes “Hello world” to a text file. Create a directory called hello_world. In the current example, its full path is
/home/theodore/tmp/hello_world |
Select your own full path and modify subsequent paths accordingly. The hello_world folder contains two bash scripts, namely hello_world.sh and hello_world_qsub.sh. The former script holds the “echo” command
1
2
3
| #!/bin/bash echo "Hello world" > /home/theodore/tmp/hello_world/hello_world_output .txt |
while the latter invokes the following “qsub” command
1
2
3
4
5
6
| #!/bin/bash qsub \ -e /home/theodore/tmp/hello_world/hello_world_qsub .error \ -o /home/theodore/tmp/hello_world/hello_world_qsub .log \ . /hello_world .sh |
The options “-e” and “-o” set respectively the paths used for the standard error and standard output stream of the job. While in the hello_world directory, submit the job by executing the hello_world_qsub.sh script:
1
| . /hello_world_qsub .sh |
You will get some output similar to
1
| Your job 1 ("hello_world.sh") has been submitted |
You can use the “qstat” command to check the progress of the submitted job. As soon as execution completes successfully, three new files will be present in the hello_world folder:
- the file hello_world_output.txt will contain a single line with the string “Hello world”,
- the file hello_world.error will be empty and
- the file hello_world.log will be empty.
Job Array Test
To confirm that submission of job arrays operates without complications, a relevant example is provided. The job array consists of five tasks, each of which echoes its ID, which is held by the environment variable $SGE_TASK_ID. Create a directory called “job_array”, whose full path is
/home/theodore/tmp/job_array |
Amend the path to fit your realization of the job array. Create two scripts in job_array, the job_array.sh and its wrapper counterpart job_array_qsub.sh. The contents of the former are
1
2
3
4
5
6
| #!/bin/bash echo "SGE_TASK_ID=$SGE_TASK_ID" > \ /home/theodore/tmp/job_array/job_array_ $SGE_TASK_ID.output.txt sleep 3 |
while the contents of the latter are
1
2
3
4
5
6
| #!/bin/bash qsub \ -e /home/theodore/tmp/job_array \ -o /home/theodore/tmp/job_array \ . /job_array .sh |
From the jog_array directory, execute the wrapper script:
1
| . /job_array_qsub .sh |
Note the double appearance of the $SGE_TASK_ID variable in job_array.sh, once as part of the name of the output files and once as a variable in the “echo” command. The resulting output will be five files job job_array_i.output.txt, for i=1, 2, 3, 4, 5, each containing a single line populated by the correpsonding string “SGE_TASK_ID=i”.
As for the job_array_qsub.sh script, notice that the argument to the “-e” and “-o” options is the full path of the job_array directory. Therefore, the standard error and output streams of the tasks of the job array will be saved in this directory. The default file name will be used, which follows the form job_name.ejob_id.task_id. In my run of the example, five empty standard error and five standard output (log) files were generated in hello_world_array, with names hello_world_array.sh.e23.[1-5] and hello_world_array.sh.o23.[1-5] respectively, where 23 happened to be the job ID at the time of execution.
A few closing remarks on the job array test run:
- The order of arguments to qsub can be critical. For instance, I made the mistake to enter the “-t 1-5″ option after the script invocation “./job_array.sh”, which threw an error.
- If you want to throttle the number of concurrently running jobs, you can use the “-tc” options. For instance, if I had defined four slots on my dual-core machine with qmon and wanted to avoid having more than one running jobs in each core, I would have used the command1
qsub -t 1-5 -tc 2 .
/job_array
.sh
- It is possible to overwrite the default file name for the standard error and standard output files of the job array, although the default naming convention is admittedly handy in several occasions. To facilitate the choice of custom file name, SGE offers the pseudo-environment variables $JOB_ID, $TASK_ID, $JOB_NAME, $HOME, $USER and $HOSTNAME. I tried to use the first four of them in the wrapper script job_array_qsub.sh, yet unfortunately they returned empty strings. I haven’t found a solution for this issue so far. I rely on the default file name as a temporary solution.
“Hello world” Job for Testing email Notification
As a final example, the “Hello world” job is rerun with a couple more qsub options so as to send an email notification upon job completion. Mail delivery is achieved in this example by using the exim4 message transfer agent. Follow the instructions of this post in order to set up exim4 to route emails through the Gmail SMTP servers. You can confirm that exim4 has been successfully configured with the help of a test “mail” command:
1
| echo "Mail body: an exim4 test" | mail -s "Mail subject: exim4 test" "recipient@somewhere.com" |
Once exim4 is set up, create a directory called “mail_test” and populate it with the mail_test.sh script
1
2
3
| #!/bin/bash echo "Hello world" > /home/theodore/tmp/mail_test/mail_test_output .txt |
and with the mail_test_qsub.sh wrapper script
1
2
3
4
5
6
7
8
| #!/bin/bash qsub \ -e /home/theodore/tmp/mail_test/mail_test_qsub .error \ -o /home/theodore/tmp/mail_test/mail_test_qsub .log \ -m e \ -M "recipient@somewhere.com" . /mail_test .sh |
The “e” argument of the “-m” qsub option instructs SGE to send the email at the end of the job.
From the mail_test directory, execute the wrapper script:
1
| . /mail_test_qsub .sh |
If everything works well, you will receive an email notifying you that job execution is complete. I received an email with subject “Job 8 (mail_test.sh) Complete” containing the following lines:
1
2
3
4
5
6
7
8
9
10
11
12
| Job 8 (mail_test.sh) Complete User = theodore Queue = mainqueue@localhost Host = localhost Start Time = 02/06/2012 21:02:43 End Time = 02/06/2012 21:02:43 User Time = 00:00:00 System Time = 00:00:00 Wallclock Time = 00:00:00 CPU = 00:00:00 Max vmem = NA Exit Status = 0 |
As a word of warning, use the mail related qsub options with care. An erroneous submission of a single job or of a job array can potentially clutter your mailbox.
##########
ERROR FAQ:
How to solve the string conversion error:
Warning: Cannot convert string to type Pixmap
Warning: Cannot convert string "intro" to type Pixmap
Warning: Cannot convert string "toolbar_job" to type Pixmap
Warning: Cannot convert string "toolbar_queue" to type Pixmap
Warning: Cannot convert string "toolbar_submit" to type Pixmap
Warning: Cannot convert string "toolbar_cplx" to type Pixmap
Warning: Cannot convert string "toolbar_host" to type Pixmap
Warning: Cannot convert string "toolbar_cluster" to type Pixmap
Warning: Cannot convert string "toolbar_sched" to type Pixmap
Warning: Cannot convert string "toolbar_calendar" to type Pixmap
Warning: Cannot convert string "toolbar_user" to type Pixmap
Warning: Cannot convert string "toolbar_pe" to type Pixmap
Warning: Cannot convert string "toolbar_ckpt" to type Pixmap
Warning: Cannot convert string "toolbar_ticket" to type Pixmap
Warning: Cannot convert string "toolbar_prj" to type Pixmap
Warning: Cannot convert string "toolbar_rqs" to type Pixmap
Warning: Cannot convert string "toolbar_ar" to type Pixmap
Warning: Cannot convert string "toolbar_browser" to type Pixmap
Warning: Cannot convert string "toolbar_exit" to type Pixmap
You can ignore these warning since they are only related with font display.You can simply rely on the position on the GUI to make it right.
What if your submitted job is always in 'qw' status even there is enough slots:
Always use your pc's hostname to replace all the instance of "localhost" mentioned in the above documentation.
What is sge version in this testing?
Answer: 6.2u5-7.4
How to handle the connection error:
error: can't find connection
error: can't get configuration from qmaster -- backgrounding
Answer: ignore.
How to reconfigure:
To reconfigure the already installed after changing your hostname (for ubuntu in /etc/hostname) to match the one you got from running the above host command:
sudo dpkg-reconfigure gridengine-master
How to remove all SGE stuff to have a clean re-installation:
sudo apt-get purge gridengine-common gridengine-exec gridengine-client
Why there is only one job running in my SGE?
If you are the admin of SGE.
1) Type qmon
2) ==>Queue Control ==> Modify ===> General Configuration ===> Slots
put your CPU number there.
Note, the default value is 1.
% qstat -f
error: commlib error: got select error (Connection refused)
error: unable to send message to qmaster using port 6444 on host "<hostname>": got send error
%
My solution is to remove SGE and have a clean re-installation. (tested on 5/25/2016)
https://supcom.hgc.jp/english/utili_info/manual/faq.html
Reference:
[1] Note, the 90% contents of this post comes from:
Installing and Setting Up Sun Grid Engine on a Single Multi-Core PC | scidom:
[2]Howto set up SGE for CUDA devices? http://serverfault.com/questions/322073/howto-set-up-sge-for-cuda-devices
[3]
How to setup a single-machine (Sun) Grid Engine installation for unit tests on Travis-CI · GitHub:
'via Blog this'
Subscribe to:
Posts (Atom)