blob: 24fc281b09329895296e0d92ac324c5fba4b374b [file] [log] [blame]
Masahiro Yamadab6160812015-05-20 11:36:07 +09001#!/usr/bin/env python2
2#
3# Author: Masahiro Yamada <yamada.masahiro@socionext.com>
4#
5# SPDX-License-Identifier: GPL-2.0+
6#
7
8"""
9Move config options from headers to defconfig files.
10
11Since Kconfig was introduced to U-Boot, we have worked on moving
12config options from headers to Kconfig (defconfig).
13
14This tool intends to help this tremendous work.
15
16
17Usage
18-----
19
20This tool takes one input file. (let's say 'recipe' file here.)
21The recipe describes the list of config options you want to move.
22Each line takes the form:
23<config_name> <type> <default>
24(the fields must be separated with whitespaces.)
25
26<config_name> is the name of config option.
27
28<type> is the type of the option. It must be one of bool, tristate,
29string, int, and hex.
30
31<default> is the default value of the option. It must be appropriate
32value corresponding to the option type. It must be either y or n for
33the bool type. Tristate options can also take m (although U-Boot has
34not supported the module feature).
35
36You can add two or more lines in the recipe file, so you can move
37multiple options at once.
38
39Let's say, for example, you want to move CONFIG_CMD_USB and
40CONFIG_SYS_TEXT_BASE.
41
42The type should be bool, hex, respectively. So, the recipe file
43should look like this:
44
45 $ cat recipe
46 CONFIG_CMD_USB bool n
47 CONFIG_SYS_TEXT_BASE hex 0x00000000
48
Joe Hershberger166edec2015-05-19 13:21:17 -050049Next you must edit the Kconfig to add the menu entries for the configs
50you are moving.
51
Masahiro Yamadab6160812015-05-20 11:36:07 +090052And then run this tool giving the file name of the recipe
53
54 $ tools/moveconfig.py recipe
55
56The tool walks through all the defconfig files to move the config
57options specified by the recipe file.
58
59The log is also displayed on the terminal.
60
61Each line is printed in the format
62<defconfig_name> : <action>
63
64<defconfig_name> is the name of the defconfig
65(without the suffix _defconfig).
66
67<action> shows what the tool did for that defconfig.
68It looks like one of the followings:
69
70 - Move 'CONFIG_... '
71 This config option was moved to the defconfig
72
73 - Default value 'CONFIG_...'. Do nothing.
74 The value of this option is the same as default.
75 We do not have to add it to the defconfig.
76
77 - 'CONFIG_...' already exists in Kconfig. Do nothing.
78 This config option is already defined in Kconfig.
79 We do not need/want to touch it.
80
81 - Undefined. Do nothing.
82 This config option was not found in the config header.
83 Nothing to do.
84
85 - Failed to process. Skip.
86 An error occurred during processing this defconfig. Skipped.
87 (If -e option is passed, the tool exits immediately on error.)
88
89Finally, you will be asked, Clean up headers? [y/n]:
90
91If you say 'y' here, the unnecessary config defines are removed
92from the config headers (include/configs/*.h).
93It just uses the regex method, so you should not rely on it.
94Just in case, please do 'git diff' to see what happened.
95
96
97How does it works?
98------------------
99
100This tool runs configuration and builds include/autoconf.mk for every
101defconfig. The config options defined in Kconfig appear in the .config
102file (unless they are hidden because of unmet dependency.)
103On the other hand, the config options defined by board headers are seen
104in include/autoconf.mk. The tool looks for the specified options in both
105of them to decide the appropriate action for the options. If the option
106is found in the .config or the value is the same as the specified default,
107the option does not need to be touched. If the option is found in
108include/autoconf.mk, but not in the .config, and the value is different
109from the default, the tools adds the option to the defconfig.
110
111For faster processing, this tool handles multi-threading. It creates
112separate build directories where the out-of-tree build is run. The
113temporary build directories are automatically created and deleted as
114needed. The number of threads are chosen based on the number of the CPU
115cores of your system although you can change it via -j (--jobs) option.
116
117
118Toolchains
119----------
120
121Appropriate toolchain are necessary to generate include/autoconf.mk
122for all the architectures supported by U-Boot. Most of them are available
123at the kernel.org site, some are not provided by kernel.org.
124
125The default per-arch CROSS_COMPILE used by this tool is specified by
126the list below, CROSS_COMPILE. You may wish to update the list to
127use your own. Instead of modifying the list directly, you can give
128them via environments.
129
130
131Available options
132-----------------
133
134 -c, --color
135 Surround each portion of the log with escape sequences to display it
136 in color on the terminal.
137
138 -n, --dry-run
139 Peform a trial run that does not make any changes. It is useful to
140 see what is going to happen before one actually runs it.
141
142 -e, --exit-on-error
143 Exit immediately if Make exits with a non-zero status while processing
144 a defconfig file.
145
146 -j, --jobs
147 Specify the number of threads to run simultaneously. If not specified,
148 the number of threads is the same as the number of CPU cores.
149
150To see the complete list of supported options, run
151
152 $ tools/moveconfig.py -h
153
154"""
155
156import fnmatch
157import multiprocessing
158import optparse
159import os
160import re
161import shutil
162import subprocess
163import sys
164import tempfile
165import time
166
167SHOW_GNU_MAKE = 'scripts/show-gnu-make'
168SLEEP_TIME=0.03
169
170# Here is the list of cross-tools I use.
171# Most of them are available at kernel.org
172# (https://www.kernel.org/pub/tools/crosstool/files/bin/), except the followings:
173# arc: https://github.com/foss-for-synopsys-dwc-arc-processors/toolchain/releases
174# blackfin: http://sourceforge.net/projects/adi-toolchain/files/
175# nds32: http://osdk.andestech.com/packages/
176# nios2: https://sourcery.mentor.com/GNUToolchain/subscription42545
177# sh: http://sourcery.mentor.com/public/gnu_toolchain/sh-linux-gnu
178CROSS_COMPILE = {
179 'arc': 'arc-linux-',
180 'aarch64': 'aarch64-linux-',
181 'arm': 'arm-unknown-linux-gnueabi-',
182 'avr32': 'avr32-linux-',
183 'blackfin': 'bfin-elf-',
184 'm68k': 'm68k-linux-',
185 'microblaze': 'microblaze-linux-',
186 'mips': 'mips-linux-',
187 'nds32': 'nds32le-linux-',
188 'nios2': 'nios2-linux-gnu-',
189 'openrisc': 'or32-linux-',
190 'powerpc': 'powerpc-linux-',
191 'sh': 'sh-linux-gnu-',
192 'sparc': 'sparc-linux-',
193 'x86': 'i386-linux-'
194}
195
196STATE_IDLE = 0
197STATE_DEFCONFIG = 1
198STATE_AUTOCONF = 2
Joe Hershberger166edec2015-05-19 13:21:17 -0500199STATE_SAVEDEFCONFIG = 3
Masahiro Yamadab6160812015-05-20 11:36:07 +0900200
201ACTION_MOVE = 0
202ACTION_DEFAULT_VALUE = 1
203ACTION_ALREADY_EXIST = 2
204ACTION_UNDEFINED = 3
205
206COLOR_BLACK = '0;30'
207COLOR_RED = '0;31'
208COLOR_GREEN = '0;32'
209COLOR_BROWN = '0;33'
210COLOR_BLUE = '0;34'
211COLOR_PURPLE = '0;35'
212COLOR_CYAN = '0;36'
213COLOR_LIGHT_GRAY = '0;37'
214COLOR_DARK_GRAY = '1;30'
215COLOR_LIGHT_RED = '1;31'
216COLOR_LIGHT_GREEN = '1;32'
217COLOR_YELLOW = '1;33'
218COLOR_LIGHT_BLUE = '1;34'
219COLOR_LIGHT_PURPLE = '1;35'
220COLOR_LIGHT_CYAN = '1;36'
221COLOR_WHITE = '1;37'
222
223### helper functions ###
224def get_devnull():
225 """Get the file object of '/dev/null' device."""
226 try:
227 devnull = subprocess.DEVNULL # py3k
228 except AttributeError:
229 devnull = open(os.devnull, 'wb')
230 return devnull
231
232def check_top_directory():
233 """Exit if we are not at the top of source directory."""
234 for f in ('README', 'Licenses'):
235 if not os.path.exists(f):
236 sys.exit('Please run at the top of source directory.')
237
238def get_make_cmd():
239 """Get the command name of GNU Make.
240
241 U-Boot needs GNU Make for building, but the command name is not
242 necessarily "make". (for example, "gmake" on FreeBSD).
243 Returns the most appropriate command name on your system.
244 """
245 process = subprocess.Popen([SHOW_GNU_MAKE], stdout=subprocess.PIPE)
246 ret = process.communicate()
247 if process.returncode:
248 sys.exit('GNU Make not found')
249 return ret[0].rstrip()
250
251def color_text(color_enabled, color, string):
252 """Return colored string."""
253 if color_enabled:
254 return '\033[' + color + 'm' + string + '\033[0m'
255 else:
256 return string
257
258def log_msg(color_enabled, color, defconfig, msg):
259 """Return the formated line for the log."""
260 return defconfig[:-len('_defconfig')].ljust(37) + ': ' + \
261 color_text(color_enabled, color, msg) + '\n'
262
263def update_cross_compile():
264 """Update per-arch CROSS_COMPILE via enviroment variables
265
266 The default CROSS_COMPILE values are available
267 in the CROSS_COMPILE list above.
268
269 You can override them via enviroment variables
270 CROSS_COMPILE_{ARCH}.
271
272 For example, if you want to override toolchain prefixes
273 for ARM and PowerPC, you can do as follows in your shell:
274
275 export CROSS_COMPILE_ARM=...
276 export CROSS_COMPILE_POWERPC=...
277 """
278 archs = []
279
280 for arch in os.listdir('arch'):
281 if os.path.exists(os.path.join('arch', arch, 'Makefile')):
282 archs.append(arch)
283
284 # arm64 is a special case
285 archs.append('aarch64')
286
287 for arch in archs:
288 env = 'CROSS_COMPILE_' + arch.upper()
289 cross_compile = os.environ.get(env)
290 if cross_compile:
291 CROSS_COMPILE[arch] = cross_compile
292
293def cleanup_one_header(header_path, patterns, dry_run):
294 """Clean regex-matched lines away from a file.
295
296 Arguments:
297 header_path: path to the cleaned file.
298 patterns: list of regex patterns. Any lines matching to these
299 patterns are deleted.
300 dry_run: make no changes, but still display log.
301 """
302 with open(header_path) as f:
303 lines = f.readlines()
304
305 matched = []
306 for i, line in enumerate(lines):
307 for pattern in patterns:
308 m = pattern.search(line)
309 if m:
310 print '%s: %s: %s' % (header_path, i + 1, line),
311 matched.append(i)
312 break
313
314 if dry_run or not matched:
315 return
316
317 with open(header_path, 'w') as f:
318 for i, line in enumerate(lines):
319 if not i in matched:
320 f.write(line)
321
322def cleanup_headers(config_attrs, dry_run):
323 """Delete config defines from board headers.
324
325 Arguments:
326 config_attrs: A list of dictionaris, each of them includes the name,
327 the type, and the default value of the target config.
328 dry_run: make no changes, but still display log.
329 """
330 while True:
331 choice = raw_input('Clean up headers? [y/n]: ').lower()
332 print choice
333 if choice == 'y' or choice == 'n':
334 break
335
336 if choice == 'n':
337 return
338
339 patterns = []
340 for config_attr in config_attrs:
341 config = config_attr['config']
342 patterns.append(re.compile(r'#\s*define\s+%s\W' % config))
343 patterns.append(re.compile(r'#\s*undef\s+%s\W' % config))
344
345 for (dirpath, dirnames, filenames) in os.walk('include'):
346 for filename in filenames:
347 if not fnmatch.fnmatch(filename, '*~'):
348 cleanup_one_header(os.path.join(dirpath, filename), patterns,
349 dry_run)
350
351### classes ###
352class KconfigParser:
353
354 """A parser of .config and include/autoconf.mk."""
355
356 re_arch = re.compile(r'CONFIG_SYS_ARCH="(.*)"')
357 re_cpu = re.compile(r'CONFIG_SYS_CPU="(.*)"')
358
359 def __init__(self, config_attrs, options, build_dir):
360 """Create a new parser.
361
362 Arguments:
363 config_attrs: A list of dictionaris, each of them includes the name,
364 the type, and the default value of the target config.
365 options: option flags.
366 build_dir: Build directory.
367 """
368 self.config_attrs = config_attrs
369 self.options = options
370 self.build_dir = build_dir
371
372 def get_cross_compile(self):
373 """Parse .config file and return CROSS_COMPILE.
374
375 Returns:
376 A string storing the compiler prefix for the architecture.
377 """
378 arch = ''
379 cpu = ''
380 dotconfig = os.path.join(self.build_dir, '.config')
381 for line in open(dotconfig):
382 m = self.re_arch.match(line)
383 if m:
384 arch = m.group(1)
385 continue
386 m = self.re_cpu.match(line)
387 if m:
388 cpu = m.group(1)
389
390 assert arch, 'Error: arch is not defined in %s' % defconfig
391
392 # fix-up for aarch64
393 if arch == 'arm' and cpu == 'armv8':
394 arch = 'aarch64'
395
396 return CROSS_COMPILE.get(arch, '')
397
Joe Hershberger166edec2015-05-19 13:21:17 -0500398 def parse_one_config(self, config_attr, defconfig_lines, autoconf_lines):
Masahiro Yamadab6160812015-05-20 11:36:07 +0900399 """Parse .config, defconfig, include/autoconf.mk for one config.
400
401 This function looks for the config options in the lines from
402 defconfig, .config, and include/autoconf.mk in order to decide
403 which action should be taken for this defconfig.
404
405 Arguments:
406 config_attr: A dictionary including the name, the type,
407 and the default value of the target config.
408 defconfig_lines: lines from the original defconfig file.
Masahiro Yamadab6160812015-05-20 11:36:07 +0900409 autoconf_lines: lines from the include/autoconf.mk file.
410
411 Returns:
412 A tupple of the action for this defconfig and the line
413 matched for the config.
414 """
415 config = config_attr['config']
416 not_set = '# %s is not set' % config
417
418 if config_attr['type'] in ('bool', 'tristate') and \
419 config_attr['default'] == 'n':
420 default = not_set
421 else:
422 default = config + '=' + config_attr['default']
423
Joe Hershberger166edec2015-05-19 13:21:17 -0500424 for line in defconfig_lines:
Masahiro Yamadab6160812015-05-20 11:36:07 +0900425 line = line.rstrip()
426 if line.startswith(config + '=') or line == not_set:
427 return (ACTION_ALREADY_EXIST, line)
428
429 if config_attr['type'] in ('bool', 'tristate'):
430 value = not_set
431 else:
432 value = '(undefined)'
433
434 for line in autoconf_lines:
435 line = line.rstrip()
436 if line.startswith(config + '='):
437 value = line
438 break
439
440 if value == default:
441 action = ACTION_DEFAULT_VALUE
442 elif value == '(undefined)':
443 action = ACTION_UNDEFINED
444 else:
445 action = ACTION_MOVE
446
447 return (action, value)
448
449 def update_defconfig(self, defconfig):
450 """Parse files for the config options and update the defconfig.
451
452 This function parses the given defconfig, the generated .config
453 and include/autoconf.mk searching the target options.
454 Move the config option(s) to the defconfig or do nothing if unneeded.
455 Also, display the log to show what happened to this defconfig.
456
457 Arguments:
458 defconfig: defconfig name.
459 """
460
461 defconfig_path = os.path.join('configs', defconfig)
462 dotconfig_path = os.path.join(self.build_dir, '.config')
463 autoconf_path = os.path.join(self.build_dir, 'include', 'autoconf.mk')
464 results = []
465
466 with open(defconfig_path) as f:
467 defconfig_lines = f.readlines()
468
Masahiro Yamadab6160812015-05-20 11:36:07 +0900469 with open(autoconf_path) as f:
470 autoconf_lines = f.readlines()
471
472 for config_attr in self.config_attrs:
473 result = self.parse_one_config(config_attr, defconfig_lines,
Joe Hershberger166edec2015-05-19 13:21:17 -0500474 autoconf_lines)
Masahiro Yamadab6160812015-05-20 11:36:07 +0900475 results.append(result)
476
477 log = ''
478
479 for (action, value) in results:
480 if action == ACTION_MOVE:
481 actlog = "Move '%s'" % value
482 log_color = COLOR_LIGHT_GREEN
483 elif action == ACTION_DEFAULT_VALUE:
484 actlog = "Default value '%s'. Do nothing." % value
485 log_color = COLOR_LIGHT_BLUE
486 elif action == ACTION_ALREADY_EXIST:
487 actlog = "'%s' already defined in Kconfig. Do nothing." % value
488 log_color = COLOR_LIGHT_PURPLE
489 elif action == ACTION_UNDEFINED:
490 actlog = "Undefined. Do nothing."
491 log_color = COLOR_DARK_GRAY
492 else:
493 sys.exit("Internal Error. This should not happen.")
494
495 log += log_msg(self.options.color, log_color, defconfig, actlog)
496
497 # Some threads are running in parallel.
498 # Print log in one shot to not mix up logs from different threads.
499 print log,
500
501 if not self.options.dry_run:
Joe Hershberger166edec2015-05-19 13:21:17 -0500502 with open(dotconfig_path, 'a') as f:
Masahiro Yamadab6160812015-05-20 11:36:07 +0900503 for (action, value) in results:
504 if action == ACTION_MOVE:
505 f.write(value + '\n')
506
507 os.remove(os.path.join(self.build_dir, 'include', 'config', 'auto.conf'))
508 os.remove(autoconf_path)
509
510class Slot:
511
512 """A slot to store a subprocess.
513
514 Each instance of this class handles one subprocess.
515 This class is useful to control multiple threads
516 for faster processing.
517 """
518
519 def __init__(self, config_attrs, options, devnull, make_cmd):
520 """Create a new process slot.
521
522 Arguments:
523 config_attrs: A list of dictionaris, each of them includes the name,
524 the type, and the default value of the target config.
525 options: option flags.
526 devnull: A file object of '/dev/null'.
527 make_cmd: command name of GNU Make.
528 """
529 self.options = options
530 self.build_dir = tempfile.mkdtemp()
531 self.devnull = devnull
532 self.make_cmd = (make_cmd, 'O=' + self.build_dir)
533 self.parser = KconfigParser(config_attrs, options, self.build_dir)
534 self.state = STATE_IDLE
535 self.failed_boards = []
536
537 def __del__(self):
538 """Delete the working directory
539
540 This function makes sure the temporary directory is cleaned away
541 even if Python suddenly dies due to error. It should be done in here
542 because it is guranteed the destructor is always invoked when the
543 instance of the class gets unreferenced.
544
545 If the subprocess is still running, wait until it finishes.
546 """
547 if self.state != STATE_IDLE:
548 while self.ps.poll() == None:
549 pass
550 shutil.rmtree(self.build_dir)
551
552 def add(self, defconfig):
553 """Assign a new subprocess for defconfig and add it to the slot.
554
555 If the slot is vacant, create a new subprocess for processing the
556 given defconfig and add it to the slot. Just returns False if
557 the slot is occupied (i.e. the current subprocess is still running).
558
559 Arguments:
560 defconfig: defconfig name.
561
562 Returns:
563 Return True on success or False on failure
564 """
565 if self.state != STATE_IDLE:
566 return False
567 cmd = list(self.make_cmd)
568 cmd.append(defconfig)
569 self.ps = subprocess.Popen(cmd, stdout=self.devnull)
570 self.defconfig = defconfig
571 self.state = STATE_DEFCONFIG
572 return True
573
574 def poll(self):
575 """Check the status of the subprocess and handle it as needed.
576
577 Returns True if the slot is vacant (i.e. in idle state).
578 If the configuration is successfully finished, assign a new
579 subprocess to build include/autoconf.mk.
580 If include/autoconf.mk is generated, invoke the parser to
581 parse the .config and the include/autoconf.mk, and then set the
582 slot back to the idle state.
583
584 Returns:
585 Return True if the subprocess is terminated, False otherwise
586 """
587 if self.state == STATE_IDLE:
588 return True
589
590 if self.ps.poll() == None:
591 return False
592
593 if self.ps.poll() != 0:
594
595 print >> sys.stderr, log_msg(self.options.color,
596 COLOR_LIGHT_RED,
597 self.defconfig,
598 "failed to process.")
599 if self.options.exit_on_error:
600 sys.exit("Exit on error.")
601 else:
602 # If --exit-on-error flag is not set,
603 # skip this board and continue.
604 # Record the failed board.
605 self.failed_boards.append(self.defconfig)
606 self.state = STATE_IDLE
607 return True
608
609 if self.state == STATE_AUTOCONF:
610 self.parser.update_defconfig(self.defconfig)
Joe Hershberger166edec2015-05-19 13:21:17 -0500611
612 """Save off the defconfig in a consistent way"""
613 cmd = list(self.make_cmd)
614 cmd.append('savedefconfig')
615 self.ps = subprocess.Popen(cmd, stdout=self.devnull,
616 stderr=self.devnull)
617 self.state = STATE_SAVEDEFCONFIG
618 return False
619
620 if self.state == STATE_SAVEDEFCONFIG:
621 defconfig_path = os.path.join(self.build_dir, 'defconfig')
622 shutil.move(defconfig_path,
623 os.path.join('configs', self.defconfig))
Masahiro Yamadab6160812015-05-20 11:36:07 +0900624 self.state = STATE_IDLE
625 return True
626
627 cross_compile = self.parser.get_cross_compile()
628 cmd = list(self.make_cmd)
629 if cross_compile:
630 cmd.append('CROSS_COMPILE=%s' % cross_compile)
631 cmd.append('include/config/auto.conf')
632 self.ps = subprocess.Popen(cmd, stdout=self.devnull)
633 self.state = STATE_AUTOCONF
634 return False
635
636 def get_failed_boards(self):
637 """Returns a list of failed boards (defconfigs) in this slot.
638 """
639 return self.failed_boards
640
641class Slots:
642
643 """Controller of the array of subprocess slots."""
644
645 def __init__(self, config_attrs, options):
646 """Create a new slots controller.
647
648 Arguments:
649 config_attrs: A list of dictionaris containing the name, the type,
650 and the default value of the target CONFIG.
651 options: option flags.
652 """
653 self.options = options
654 self.slots = []
655 devnull = get_devnull()
656 make_cmd = get_make_cmd()
657 for i in range(options.jobs):
658 self.slots.append(Slot(config_attrs, options, devnull, make_cmd))
659
660 def add(self, defconfig):
661 """Add a new subprocess if a vacant slot is found.
662
663 Arguments:
664 defconfig: defconfig name to be put into.
665
666 Returns:
667 Return True on success or False on failure
668 """
669 for slot in self.slots:
670 if slot.add(defconfig):
671 return True
672 return False
673
674 def available(self):
675 """Check if there is a vacant slot.
676
677 Returns:
678 Return True if at lease one vacant slot is found, False otherwise.
679 """
680 for slot in self.slots:
681 if slot.poll():
682 return True
683 return False
684
685 def empty(self):
686 """Check if all slots are vacant.
687
688 Returns:
689 Return True if all the slots are vacant, False otherwise.
690 """
691 ret = True
692 for slot in self.slots:
693 if not slot.poll():
694 ret = False
695 return ret
696
697 def show_failed_boards(self):
698 """Display all of the failed boards (defconfigs)."""
699 failed_boards = []
700
701 for slot in self.slots:
702 failed_boards += slot.get_failed_boards()
703
704 if len(failed_boards) > 0:
705 msg = [ "The following boards were not processed due to error:" ]
706 msg += failed_boards
707 for line in msg:
708 print >> sys.stderr, color_text(self.options.color,
709 COLOR_LIGHT_RED, line)
710
711def move_config(config_attrs, options):
712 """Move config options to defconfig files.
713
714 Arguments:
715 config_attrs: A list of dictionaris, each of them includes the name,
716 the type, and the default value of the target config.
717 options: option flags
718 """
719 check_top_directory()
720
721 if len(config_attrs) == 0:
722 print 'Nothing to do. exit.'
723 sys.exit(0)
724
725 print 'Move the following CONFIG options (jobs: %d)' % options.jobs
726 for config_attr in config_attrs:
727 print ' %s (type: %s, default: %s)' % (config_attr['config'],
728 config_attr['type'],
729 config_attr['default'])
730
731 # All the defconfig files to be processed
732 defconfigs = []
733 for (dirpath, dirnames, filenames) in os.walk('configs'):
734 dirpath = dirpath[len('configs') + 1:]
735 for filename in fnmatch.filter(filenames, '*_defconfig'):
736 defconfigs.append(os.path.join(dirpath, filename))
737
738 slots = Slots(config_attrs, options)
739
740 # Main loop to process defconfig files:
741 # Add a new subprocess into a vacant slot.
742 # Sleep if there is no available slot.
743 for defconfig in defconfigs:
744 while not slots.add(defconfig):
745 while not slots.available():
746 # No available slot: sleep for a while
747 time.sleep(SLEEP_TIME)
748
749 # wait until all the subprocesses finish
750 while not slots.empty():
751 time.sleep(SLEEP_TIME)
752
753 slots.show_failed_boards()
754
755 cleanup_headers(config_attrs, options.dry_run)
756
757def bad_recipe(filename, linenum, msg):
758 """Print error message with the file name and the line number and exit."""
759 sys.exit("%s: line %d: error : " % (filename, linenum) + msg)
760
761def parse_recipe(filename):
762 """Parse the recipe file and retrieve the config attributes.
763
764 This function parses the given recipe file and gets the name,
765 the type, and the default value of the target config options.
766
767 Arguments:
768 filename: path to file to be parsed.
769 Returns:
770 A list of dictionaris, each of them includes the name,
771 the type, and the default value of the target config.
772 """
773 config_attrs = []
774 linenum = 1
775
776 for line in open(filename):
777 tokens = line.split()
778 if len(tokens) != 3:
779 bad_recipe(filename, linenum,
780 "%d fields in this line. Each line must contain 3 fields"
781 % len(tokens))
782
783 (config, type, default) = tokens
784
785 # prefix the option name with CONFIG_ if missing
786 if not config.startswith('CONFIG_'):
787 config = 'CONFIG_' + config
788
789 # sanity check of default values
790 if type == 'bool':
791 if not default in ('y', 'n'):
792 bad_recipe(filename, linenum,
793 "default for bool type must be either y or n")
794 elif type == 'tristate':
795 if not default in ('y', 'm', 'n'):
796 bad_recipe(filename, linenum,
797 "default for tristate type must be y, m, or n")
798 elif type == 'string':
799 if default[0] != '"' or default[-1] != '"':
800 bad_recipe(filename, linenum,
801 "default for string type must be surrounded by double-quotations")
802 elif type == 'int':
803 try:
804 int(default)
805 except:
806 bad_recipe(filename, linenum,
807 "type is int, but default value is not decimal")
808 elif type == 'hex':
809 if len(default) < 2 or default[:2] != '0x':
810 bad_recipe(filename, linenum,
811 "default for hex type must be prefixed with 0x")
812 try:
813 int(default, 16)
814 except:
815 bad_recipe(filename, linenum,
816 "type is hex, but default value is not hexadecimal")
817 else:
818 bad_recipe(filename, linenum,
819 "unsupported type '%s'. type must be one of bool, tristate, string, int, hex"
820 % type)
821
822 config_attrs.append({'config': config, 'type': type, 'default': default})
823 linenum += 1
824
825 return config_attrs
826
827def main():
828 try:
829 cpu_count = multiprocessing.cpu_count()
830 except NotImplementedError:
831 cpu_count = 1
832
833 parser = optparse.OptionParser()
834 # Add options here
835 parser.add_option('-c', '--color', action='store_true', default=False,
836 help='display the log in color')
837 parser.add_option('-n', '--dry-run', action='store_true', default=False,
838 help='perform a trial run (show log with no changes)')
839 parser.add_option('-e', '--exit-on-error', action='store_true',
840 default=False,
841 help='exit immediately on any error')
842 parser.add_option('-j', '--jobs', type='int', default=cpu_count,
843 help='the number of jobs to run simultaneously')
844 parser.usage += ' recipe_file\n\n' + \
845 'The recipe_file should describe config options you want to move.\n' + \
846 'Each line should contain config_name, type, default_value\n\n' + \
847 'Example:\n' + \
848 'CONFIG_FOO bool n\n' + \
849 'CONFIG_BAR int 100\n' + \
850 'CONFIG_BAZ string "hello"\n'
851
852 (options, args) = parser.parse_args()
853
854 if len(args) != 1:
855 parser.print_usage()
856 sys.exit(1)
857
858 config_attrs = parse_recipe(args[0])
859
860 update_cross_compile()
861
862 move_config(config_attrs, options)
863
864if __name__ == '__main__':
865 main()